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ABSTRACT 



A cohesive and detailed treatment of the theory and 
engineering implications of trajectory sensitivity is pre- 
sented. Fundamental results that provide insight into the 
theoretical aspects of trajectory sensitivity analysis, in 
both the frequency and time domains, are reviewed. Several 
related methods for incorporating sensitivity considerations 
in the design of systems are presented and used to solve a 
meaningful fifth-order numerical example: a flexible space 

vehicle in booster powered flight. Comparisons are made 
between an optimal design and designs which include a sen-- 
sitivity term in the performance measure and conclusions 



0 ci >o 2.v* Tr i cLit this Q ° c u cl* t h 0 s ° t c o n — 



trol system design 



2 



TABLE OF CONTENTS 



I. INTRODUCTION 5 

II. HISTORICAL REVIEW 10 

A. CLASSICAL SENSITIVITY 10 

B. OPTIMAL CONTROL SENSITIVITY 13 

III. SENSITIVITY ANALYSIS 18 

A. NOTATION 18 

B. TRANSFORM ANALYSIS 19 

1. Single-Input Systems 19 

2. Multiple-Input Systems 30 

C. STATE TRAJECTORY SENSITIVITY 38 

1. Linear System State Trajectory 

Sensitivity *15 

D. PERFORMANCE SENSITIVITY 46 

E. SUMMARY 50 

IV. TRAJECTORY SENSITIVITY DESIGN 53 

A. GENERAL PROCEDURE 53 

B. LINEAR REGULATOR SENSITIVITY DESIGN 55 

C. THE CASSIDY AND LEE CONTROL -STRATEGY 6 7 

D. THE KAHNE CONTROL STRATEGY 70 

V. APPLICATIONS OF SENSITIVITY DESIGN TECHNIQUES 

TO A FLEXIBLE SATURN BOOSTER PROBLEM 75 

A. THE PROBLEM — — 75 

B. OPTIMAL SOLUTION 80 

C. KAHNE 'S METHOD 88 

D. CASSIDY AND LEE'S METHOD 96 

E. USE OF Q MATRIX FOR REDUCED SENSITIVITY 106 

F. DISCUSSION OF RESULTS 116 



3 



VI. CONCLUSIONS 130 

A. SUMMARY 130 

B. RECOMMENDATIONS 133 

LIST OP REFERENCES 138 

INITIAL DISTRIBUTION LIST l4l 

FORM DD 1473 142 



I. INTRODUCTION 



During recent years, the search for solutions to op- 
timal control system problems has been quite intensive. 

In particular, optimal feedback control of linear dynamical 
systems has been studied extensively. This attention to 
feedback control is well placed. As Bode pointed out [1], 
feedback control is particularly desirable in that it 
1) tends to stablize systems, 2) reduces the effects on 
the output due to extraneous noise or non-linear distor- 
tion in the plant, and 3) tends to reduce the effects on 
the system transfer characteristics caused by variation in' 
plant parameters. The research in the area of optimal lin- 
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knowledge about the theoretical aspects of the unconstrained 
linear state regulator problem. The necessary and sufficient 
conditions for the solution of this problem are well known 
[2, 3 , *»]. Despite apparently complete knowledge concerning 
optimal linear state regulator control theory, its implemen- 
tation in practical applications generally requires the use 
of digital computers and may be limited in many instances 
by cost considerations. 

There are several other reasons why the optimal linear 
state regulator solution may not be implemented. These 
reasons are related to necessary conditions or assumptions 
required for the theoretical solution of the problem (all 
states available for feedback, control unconstrained and 
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time-varying) or engineering considerations concerned with 
formulation of the system model and its controller. Among 
the latter are considerations for the sensitivity of the 
response of a dynamic system to variations in plant para- 
meters . 

Every control problem, modern or classical, begins 
with the formulation of a system model. Generally, this 
model takes the form of one or more nonlinear time varying 
differential equations. This nontrivial process of system 
modelling, perhaps after much refinement, can ultimately 
result in a system described by a set of first-order ordi- 
nary differential state equations [5] of the form 

x(t) = a[x(t) ,gXt) ,u(t) ,t] (1.1) 

where x(t) is the state n-vector 

c[(t) is the variable parameter r-vector 

u(t) is the control input m-vector 

t is the independent variable, usually time. 

A physical system mathematically modelled by equations 
of the form of (1.1) are the subject of extensive design 
and analysis techniques. The results of these techniques 
are generally assumed to be valid and applicable to the 
physical system. The validity of this assumption requires 
careful scrutiny. 

No matter how careful and precise the engineer is in 
establishing his model, there will always exist differences 
between the behavior of the physical system and that pre- 
dicted by equations like (1.1). The vector function, a( . ) , 
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in (1.1) cannot , in general, be exactly determined. The 
parameters q(t) are, for many meaningful systems, diffi- 
cult to measure accurately and in any event will have tol- 
erances associated with them. The solution of (1.1) will 
generally yield only to the approximate techniques of the 
digital or analog computer. Even if the modelling diffi- 
culties mentioned above did not exist, the problem of 
changes in system components due to aging, environmental 
changes and repair part exchanges w T ould introduce model- 
ling inaccuracies. It is clear that even under the very 
best of circumstances, differences will exist between the 
system and its model. 

In order to obtain the advantages of linear optimal 
control theory 3 e non H no or system msiy be solved for its 
optimal trajectory and then an approximate linear system 
may be formulated relating small variations from the non- 
linear optimal trajectory. The approximations involved 
lead to model inaccuracies and again differences between 
system- behavior and modelled behavior will exist. 

In many physical plants, all of the states are not 
available for feedback. In this case, implementation of 
the optimal linear state regulator problem may not be fea- 
sible [3]. However, if the system is completely observ- 
able, the states can be computed from the output [4]. 
Schemes for obtaining the system states from the system 
output include the use of observers [6] and Kalman filters 
[7]. However, these techniques use the system model in 
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their realizations and consequently introduce additional 
variations into the system. 

Assuming that the modelling process and the model's 
solution is an accurate representation of the plant, trans- 
lating the solution into controller signals or action is 
subject to many of the variations discussed above. Hence, 
implementation of the controller may introduce system in- 
accuracies . 

Ignoring all of these difficulties, the "perfectly" 
modelled plant and "perfectly" implemented controller may 
still be inadequate. This "perfect" system may be unable 
to cope successfully with random or even deterministic 
disturbance inputs to which the system may be subjected. 

Over the years as classical feedback theory has been 
developed, in recognition of the many uncertainties in- 
herent in system design, a compatible theory for sensitiv- 
ity analysis has also been developed [8]. This theory for 
the most part is based on Bode's definition [1] of sensi- 
tivity. From it developed a "Folk Theorem" [9] which 
states in effect that the sensitivity of the transfer 
characteristics of a system to parameter variations is re- 
duced as the feedback gains are increased. This theorem 
works in many cases, and is frequently the only tool ap- 
plied to sensitivity reduction in the design of many clas- 
sical controllers. 

Presently considerable research effort is being di- 
rected at the problem of developing sensitivity analysis 
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and reduced sensitivity design techniques compatible with 
modern control theory. In multiple-input multiple-output 
systems cast as optimal control problems interest has been 
concentrated in several system characteristics in addi- 
tion to the system transfer function. These include the 
sensitivities of state trajectories, performance measures, 
system eigenvalues, and final states to variations of ini- 
tial conditions and plant or controller parameters. 

In this thesis, an historical review of sensitivity 
theory compatible with modern control theory is presented. 
Next a general theory for trajectory sensitivity analysis 
is reviewed and applied to the optimal state regulator 
problem. Then several current techniques proposed for 
designing optimal linear regu.ls.iors with reduced sensitiv- 
ities are investigated. Finally some of these techniques 
are applied to the solution of a flexible Saturn booster 
problem and the resulting numerical solutions are compared. 



9 



II. HISTORICAL REVIEW 



A. CLASSICAL SENSITIVITY 

The basic concepts that provide the foundation for 
modern sensitivity theory appeared in the fundamental work 
of Bode [1] which also marks the beginning of the modern 
theory of feedback systems. Bode defined feedback in terms 
of the return difference and at the same time established 
several important relationships between feedback and sensi- 
tivity. In the development of automatic control theory 
that followed, analysis and design formulations should have 
included sensitivity as an important adjunct. Such, how- 
ever, was not the case. Until the beginning of the last 
decade ; little can be found in the literature relating con- 
trol systems and sensitivity. In an important exception 
[10], Truxal briefly discussed return difference and sen- 
sitivity within the context of signal flow graphs. 

Horowitz [11] argued that the use of feedback loops 
to reduce sensitivity of the system transfer function to 
substantial plant parameter variations or random distur- 
bances is as effective as the use of adaptive systems with- 
out their added complexity. He concluded, by using the 
classical sensitivity analysis techniques, that the inade- 
quacies attributed to feedback systems by adaptive system 
designers were unfounded. Indeed, given the same design 
constraints, he demonstrated that whatever performance had 
been claimed for adaptive systems could be matched with con- 
siderably less complexity by feedback control systems. In 
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his book. Synthesis of Feedback Systems [12] , Horowitz 
provided an excellent and complete treatment of classical 
control system design with sensitivity considerations. He 
applied the classical design techniques (root locus. Bode 
plots, Nyouist criterion) to the design of systems with 
reduced sensitivity to plant parameter variations and ran- 
dom input disturbances. 

It should be noted that almost all of these early 
studies [1, 10, 11, 12] were confined to Laplace transform 
and frequency domain analysis of sensitivity. These tech- 
niques were applied mainly to determining the sensitivity 
of the system transfer function to changes of a system pa- 
rameter. Root locus techniques were applied also to deter- 
mins ths ssnsit ivi.ty of* pols— zone location? t n vsnis.t-ions 
of a system parameter [12]. Horowitz pointed out [12] 
that the desired system performance is generally a time 
domain specification, and that any correlation that exists 
between system frequency response and time response is ap- 
proximate. If system time response is accurately required, 
then a time domain synthesis technique must be used. 

Miller and Murray [13] > in establishing a mathematical 
ly sound basis for error analysis for the solutions of ordi 
nary differential equations by machine methods, derived the 
differential equation that describes the sensitivity coef- 
ficients of the system. This same "sensitivity equation" 
provided the time domain sensitivity analysis techniques 
described by Tomovic [8] . 
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Kokotovic [14] proposed his "sensitivity points" 
method for linear systems by which the sensitivity of the 
system scalar output to variations of each of the plant 
parameters could be obtained. In fact, when implemented 
on the analog computer all of these sensitivities could 
be obtained simultaneously. This time domain method was 
extended to provide an automatic analog computer parameter 
^minimization of the difference between a norm of the out- 
put trajectory of an analog system and the output of a 
specified standard model. 

In a recent paper [15] , Wilkie and Perkins presented 
a method of finding the sensitivities of all of the states 
of a linear time-invariant system to each of the system 
parameters simultaneously. The method required modelling 
the n-th order linear system in the companion canonic state 
form, plus an additional n-th order sensitivity model and 
a single-input n-th order system model for each input in 
excess of 1. This led to the requirement of 2m- 1 n-th 
order models independent of the number of parameters for 
a system having m inputs. This was a considerable reduc- 
tion in the number of models required over previous tech- 
niques, where an n-th order sensitivity model was required 
for each parameter considered. The Perkins-Wilkie method 
assumed that the linear system could be transformed into 
the companion canonic state form. 
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B. 



OPTIMAL CONTROL SENSITIVITY 



It is interesting that the first published results 
concerning the sensitivity of optimal control systems [16] 
turned out to be a restatement of Bode's theorem relating 
return difference and sensitivity. Kalman, in solving the 
inverse problem of optimal control theory for linear state 
regulator problems, established a necessary condition for 
its solution. He showed that if a feedback control law is 
optimal, then the magnitude of the return difference for 
the feedback system must be greater than one. Additional 
results are obtained that tend to bridge the gap, to some 
extent, between classical and optimal control theory. 
Kalman's very complete discussion included important re- 
su.lt s concerning s tr 1 11 1 y improvement ol* sensitivity end 
frequency-domain criteria for this essentially time domain 
problem. 

In a development similar to that of [16] , Perkins and 
Cruz [17] developed a sensitivity matrix operator which 
relates the open-loop and closed-loop system output varia- 
tions. They established a sensitivity index which is a 
measure of the weighted mean square output error. By ap- 
plying Parseval's theorem to the sensitivity index, they 
derived a frequency domain sufficiency condition that en- 
sures sensitivity reduction. Additionally Perkins and Cruz 
demonstrated that if a system is designed to satisfy the 
sufficiency condition mentioned above, then the system is 
optimal in the sense that the constant, linear control law 
obtained minimizes an infinite-time quadratic performance 
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measure and at the same time transfers the states of a 
linear time-invariant completely controllable system from 
some initial state to the origin asymptotically. 

Kreindler in [ 1 8 ] derived results similar to those of 
[16] and [17]. He established sufficient conditions which 
guarantee for multiple-input multiple-output linear regu- 
lator systems that the integral of a certain quadratic form 
of the closed-loop sensitivity is less than the correspond- 
ing integral for the open-loop system. Additionally, for 
single-input systems in the companion canonic form, the 
sufficiency condition ensured that the integral of the 
square of each closed- loop sensitivity trajectory will be • 
less than the corresponding open-loop integral. This was 
s. valuable result . 

The analysis techniques discussed in the literature 
cited above have not resulted in established design tech- 
niques. Several authors [ 19 , 20, 21, 22] defined a sensi- 
tivity differential equation after Miller and Murray [13] 
for each variable parameter, augmented the resulting dif- 
ferential equations to the system state equations, defined 
a performance measure with added quadratic terms measuring 
sensitivity, and then solved the resulting system using 
the Hamiltonian and Pontryagin's maximum principle to ob- 
tain a reduced sensitivity design. The resulting feedback 
control law was a linear combination of the system states 
and the augmented state sensitivities. 

Dompe and Dorf [21] demonstrated with a second-order 
example, that Kahne 1 s [19] design scheme does indeed result 
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in a feedback control system with reduced sensitivity. 

The control law did not result in the optimal solution of 
the mathematical model defined because Kahne neglected the 
effects of parameter variation on the feedback states. 

Cassidy and Lee [22] included the terms excluded by 
Kahne . 

D’Angelo, et.al., [20] proposed a reduced sensitivity 
design technique with an infinite-time performance measure 
resulting in constant feedback gains. 

Higginbotham [23] included an additional term in the 
sensitivity differential equation that was neglected both 
by Kahne [19] and Cassidy and Lee [22] . He presented a 
comparison of [19] and [22] using a first-order example. 

By use of the example, he demonstrated that the Cassidy 
and Lee technique results in a lower "cost" than Kahne ’ s 
technique. No comparison was made of the resulting sensi- 
tivity reduction, if any. 

All of the above optimal sensitivity analysis and 
design techniques were concerned with transfer function or 
trajectory sensitivity. Considerable research has also 
been directed at the so-called performance sensitivity 
problem. The concern here is with variations in the per- 
formance index resulting from parameter variations. In a 
basic result, Pagurek [24] demonstrated that the performance 
index sensitivity to plant parameter variations for open- 
loop and closed-loop optimal linear state regulators are 
equal. This is an astounding result that seemed to imply 
the benefits of feedback with respect to plant parameter 
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variations were not available to optimal linear systems. 
This result was extended to a large class of nonlinear op- 
timal control problems by Witsenhausen [ 25 ] . 

Although the results of [24] and [25] hold for infin- 
itesimal parameter variations, Sinha and Atluri [26] showed 
that for finite but small variations the closed-loop per- 
formance index sensitivity is less than the open-loop sen- 
sitivity. Kreindler [18] made a similar argument in favor 
of feedback systems . 

In a design procedure for minimizing performance mea- 
sure sensitivity Rohrer and Sobral [27] introduced a "rela- 
tive sensitivity" function. The procedure resulted in a 
minimax solution that is applicable for large parameter 
variations . 

Salmon [28] generalized the Rohrer and Sobral proce- 
dure and proposed a new minimax algorithm for its solution. 

Very recently Cassidy and Roy [29] described what ap- 
pears to be a promising scheme for designing insensitive 
linear output regulator systems. By modifying the usual 
quadratic performance measure they were able to constrain 
the feedback coefficients multiplying the unmeasured states 
to zero. Thus output feedback was obtained. They defined 
the state sensitivity differential equations, adjoined them 
to the state equations to form an augmented state vector. 

A sensitivity term was added to the performance measure and 
their Specific Optimal Control (SOC) approach resulted in a 
constant feedback controller that did not require knowledge 
of the sensitivity variables nor the unmeasured states. 
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Much work in the area of sensitivity design remains to 
be done. All of the proposed design techniques have severe 
limitations that in general do not admit to practical ap- 
plication. These limitations and some proposals for im- 
proved techniques will be discussed subsequently. 
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III. SENSITIVITY ANALYSIS 



The objective of sensitivity analysis is to quantita- 
tively predict the effect of disturbances on the dynamic 
behavior of a system. This implies the development of a 
model of system sensitivity perhaps not unlike the system 
model. In fact, this is the case. When the system model 
is described by transform techniques, for example, generally 
the sensitivity analysis is developed using the same tech- 
niques [10, 11, 12]. Dynamical systems modelled in the time 
domain are frequently analyzed for sensitivity by transform 
operators [16, 17, 18] or in the time domain [13, 14, 15, 

19, 20, 22, 23, 29]- The remainder of this thesis will be 
devoted to dynamical systems that can be described by si- 
multaneous ordinary differential state equations of the form 
of (1.1) . 

A . NOTATION 

The behavior of the plant is completely specified by 
the differential system 



x(t) = a[x(t) ,u(t) ,q(t) ,t] 
x( t 0 ) = c 



(3-D 



where x(t) is the real n-dimensional state vector, u(t) is 
the real n-dimensional control vector, q(t) is the real r- 
dimensional parameter vector, and a( . ) is an n-dimensional 
vector function. In general, capital Roman letters will 
denote matrices, lower-case Roman letters vectors, and 
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lower case Greek letters scalars. Exceptions may occur in 
order to conform with general practice. These exceptions 
will be obvious. 

B. TRANSFORM ANALYSIS 

1 . Single-Input Systems 

The completely controllable [3> 30] constant lin- 
ear dynamical system to be considered is described by 

x(t)=Ax(t)+Bu(t) (3*2) 

x (t 0 ) = £ 

which is optimized by the control law 

u(t) = Fx( t ) (3-3) 

with respect to the performance measure 

J = h f (x'Qx + u'Ru)dt (3.-4) 

* o 

where Q is a non-negative definite constant symmetric ma- 
trix and R is a positive definite constant symmetric ma- 
trix. The prime denotes the transpose. 

The solution to this problem in the form of a con- 
stant linear feedback control law (3-3) has been demonstrated 
by Kalman [ 3 ]. The matrix F is given by 

F = -R -1 B'K (3-5) 

where K is the positive definite symmetric solution of the 
Riccati matrix equation 

KBR _1 B’K - KA - A'K - Q = 0. (3-6) 
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Kalman [ 1 6 ] considered such a system restricted 
to a single input y(t) , described by 

x(t) = Ax(t) + by(t) (3-7) 

x(0) = c . 

Figure 1 is a block diagram of the structure of this system. 
This system can be represented in Laplace transform nota- 
tion, ignoring initial conditions, by 

sX(s) = AX(s) + bU( s ) . (3-8) 




Figure 1. Linear single-input optimal control system. 

From (3*8) one can obtain 

X(s) = $(s.)bU(s), (3-9) 

where $(s) = (sI-A) -1 is the Laplace transform of the funda- 
mental matrix. Multiplying both sides of (3-9) by f ' , 
yields the scalar equation 

f 'X(s) = f ' $(s)bU(s) . 
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With N(s) = f'X(s) , then 



N(s)/U(s) = f'$(s)b (3-10) 

is the open-loop transfer function. 

The homogeneous, closed-loop form equation for 
the system of Figure 1 is given by 

x = ( A+bf ' )x. ( 3 • 11) 

The fundamental matrix for system (3.11) is 

$ k (s) = 

In the following development the open-loop and closed-loop 
characteristic polynomials will be required. They are 
( s ) = det(sI-A) and ( s ) = det ( sI-A-bf ' ) respectively. 

Continuing the algebra as follows 

H'^(s) = det ( sI-A-bf ' ) 

= det [ sI-A-(sI-A) (sI-A) - 1 bf ' ] 

_ i 



= det[(sI-A) (I-(sI-A) bf')] 

= det [(sI-A)(I-$(s)bf ' )] 



= det (sI-A)det (I-$(s)bf ' ) 



= y( s ) det (!-<!>( s )bf ' ) 



Y k (s) = Y(s) (1-f ’$(s)b) 
finally yields 

V k (s)/Y(s) = (l-f'$(s)b), (3.12) 

where the last step depends on a determinantal identity 
proved in [31]. The quantity ( 1-f ' $ ( s )b ) is the classical 
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return difference. Solving (3.12) for f'<I>(s)b and substi- 
tuting into (3*10) yields 



N(s)/U(s) = 



ns) - T k (s) 

fTsl 



(3.13) 



Since Q is non-negative definite and symmetric 
there is a matrix P such that P'P = Q. Using this fact 
and letting the term u'Ru = y 2 (single-input system), equa- 
tions (3.4), ( 3 . 5)3 and (3-6) can be written as: 



/; 



J = h 1 [(x'P’Px) + y 2 ]dt 

0 - 



(3.14) 



and 



f’ = -b’K 



Kbb'K - KA-A'K-P'P = 0 



(3.15) 



( 3 . 16 ) 



Kalman [16] proves that the K which satisfies 
( 3 . 15 ) and ( 3 . 16 ) also satisfies 

-ff '-K(A+bf ’ ) - ( A ' + f b ' ) K - P'P = 0 



(3.17) 



and that : 

Theorem 1. Given a completely controllable con- 
stant linear single-input system ‘(3-7) and the performance 
measure (3.14) such that the pair [A,P] is completely ob- 
servable [3 5 30], a necessary and sufficient condition for 
f to be a constant stable optimal control law is that there 
exist a matrix K which satisfies the algebraic relations 



K = K' is positive definite 
f = - Kb 

- K(A+bf ' ) - ( A ' + f b ' ) K = P'P+ff'. 



( 3 - 18 ) 

(3.19) 

(3-17) 
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Equation (3-17) together with K = K' is positive 
definite implies f is a stable control law and that 
(A + bf') is a stability matrix according to Lyapunov 
stability theory [5] . 

Theorem 1 provides a relationship that connects 
f and P. However the relationship is not easily inter- 
preted and is certainly not very useful as a design tool. 
Kalman continues his development and finds another rela- 
tionship between f and P in which K has been eliminated. 

Adding and subtracting sK in equation (3. 16) gives 

K(sl-A) + (-sI-A')K = P'P - Kbb'K, 

and 

K[£(s)] _1 + [^'(-s)]" 1 ^ = P’P - Kbb'K. (3-20) 

Premultiplying and post multiplying (3*20) by b'$'(-s) and 
j>(s)b respectively yields the scalar equation 

b'$'(-s)Kb + b'K$(s)b = b'$'(-s)[P'P - Kbb'K]$(s)b. 

Substituting f = -Kb yields 

-b' $' (-s)f - f'$(s)b = b'f (-s)P'P$(s)b - b » $ 1 (-s ) f f ’ $(s )b . 
which can be written 

[1 - b ' $ ' (-s ) f ] [l-f'$(s)b] = 1 + b '$' (-s)P'P$(s)b. 

Substituting s = jio gives the desired result. 

|1 - f ' ( j to ) | = 1 + | |P$(jw)b| | 2 (3-21) 

where the notation ||Z|| 2 implies the quadratic form Z'Z. 
Kalman's result [16] can now be stated: 

Theorem 2. Given a completely controllable con- 
stant linear single-input system (3-7) and the performance 
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measure (3.14) such that the pair [A,P] is completely ob- 
servable, a necessary and sufficient condition for f to be 
a constant optimal control law is that f be stable and that 
(3*21) hold for all to. 

Equation (3*21) implies that for f to be a con- 
stant optimal control law, the magnitude of the return dif- 
ference must be greater than unity for all to, i.e., 

I T ( j to ) | = |1 - f'£(jco)b|>l. (3.22) 

This result ensures that stable control laws satisfying 
(3-22) will provide a feedback system with reduced sensi- 
tivities to variations of parameters in the plant compared 
to the same plant with an equivalent open-loop control. It 
also implies that the larger the return difference, the less 
sensitive the plant will be. This is shown by demanding 
that the return difference Ti(jto) for control law fi be 
greater in magnitude than T 2 (jto) for f 2 . That is 

|Ti ( jco)/T 2 ( jco) | >1 (3-23) 

will ensure that the system with control law fi will be less 
sensitive than the same system with control law f 2 . 

This follows from 



I T 1 ( j to ) | = |<4i ( jco)/^( jto) | 
I T 2 ( j to) | = |^2 ( jw)/<4( jto) | 



(3.24) 



and equation (3.12). 

Although this formulation provides a means of 
evaluating various control lav/s, it does not appear to be 
very useful as a design procedure. If a means of finding 



the matrix Q which satisfies the conditions of theorem 2 
can be obtained, a design procedure of practical utility 
could be established. It seems that further investigation 
of this aspect of the problem might be fruitful. 



timal stable control law for a completely controllable con- 
stant single-input plant which minimizes the performance 
measure (3*1^) subject to the constraints of (3-7) will 
also satisfy (3*21). Therefore, such a control law satis- 
fies (3*22) and the resulting closed-loop system will have 
reduced sensitivity when compared to the same system with 
an equivalent open-loop control. This is an important re- 
sult and adds considerable meaning to the term "optimal" 
for this problem . 



trix that results in an optimal control law f in the sense 
that equation (3-22) is satisfied, from (3*12) and (3-22) 
one can write 



Kalman's result guarantees that any constant op- 



Approaching the problem of constructing a Q ma- 



ll - f'<Ks)b| 2 = |4 , k (s)/'F(s) 1 2 >1 



( 3 . 25 ) 



and therefore. 



(3.26) 



[1 - f’(-sI-A) \] [1 - f'(sI-A) \] = 




£ > I 

!(-s)f(s) 



or 



V-s)V s ) " 



( 3 . 27 ) 



f (-s)f (sT 



In the above equations, the relation 



j'F(s) | 2 = Y(s)¥(-s) 



( 3 - 28 ) 
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which holds for polynomials with real coefficients has been 
used. In order to evaluate ( 3 - 27 ), using the fact that the 
pair [A,b] is completely controllable, the system 

x = Ax + by 



can be transformed into the companion form by z = Tx. Pro- 
ceeding as follows 



or 



where 



Tx = TAT 1 Tx + Tby 



z = Cz + dy 



C 



0 1 0 . 

0 0 1 

0 0 0 

< ’ 



0 



\ 



• > 



and 



-Oil “«2 






\ 

0 



d = \ . / 



1 



-a 



n 



J 



Since the characteristic polynomial is invariant 
under the linear, non-singular transformation T, ¥(s) can 
be written as 
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Y(s) = det(sl - A) - det (si - C) 



and similarly for ¥^(s). The control law for this system 
is 

y = f ' z 



where 



f' = { Y Y Y • • • Y ) • 
123 n 



A well known method for finding the inverse is 
expressed by 



M 



- 1 



adjM 



detM 



- 1 



Using this technique yields for (si - C) d 



( si - C ) 1 d = 



[adj (si - C) ]d 
det ( si - C) 



/I 






M • 



n-1; 
> s / 



Premultiplying by f ' , 



n-1 

- 1 Y n s + Y n n 

f'(sl - C) d = J? n_1 



n-2 , , 

s + • • • + y , 



s n + a s n 1 + a ,s n ^+*»*+ a. 
n n-1 i 



( 3 - 29 ) 
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From the definition of d and f one can obtain 






0 0 



df ' = < . 



Y Y 
1 2 



Y 



n 



and 



r 



C + df' = < . 



1 

0 



0 . . . 

1 . . . 



,Y -a y -a 
\ 1 12 2 



Y -a . 
n n/ 



Since Y, (s) - det(sl - C - df), it follows that 



- i 



f ' (si - C) d = Y(s ) - Y k (s) 

T(J) 



(3 



This same result is determined directly from (3» 
but in the present development Y(s) - Y k (s) is determined 
from (3-29) and (3-30) to be 

Y(s) - Y. (s) = Ys n- ^ + Y iS n " 2 + . . . + Y • ( 
k v ' n 1 n-1 1 l 

Inequality (3-26) can be rewritten as 

\(s)Y (-s.) - Y(s)Y(-s) 

Y(s)Y(-s) > 0 • ( 3 

The numerator polynomial of (3-32) can be factored as 

\ ( s ) Y k (-s ) - Y(s)Y(-s) = <S(s)6(-s) (3 



• 30) 
12 ) , 

3-31) 

.32) 

• 33) 
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where 6(s) is a polynomial, of degree at most n-1, having all 
its zeros in the left-half s-plane. Defining the Hurwitz 
polynomial 

6(s) = g n s n_1 + & n _^ U ~ 2 + • • • + g x (3-34) 



and the vector 



g = 



(3-35) 



/g \ 



g. 



< ‘ > 



V S n, 



the inequalities (3.26) and (3-32) can be combined with (3*33) 
to yield 



(3-36) 



- i 



[1 - f ' (-si - C) *d] [1 - f ’ (si - C) X d] = + 1 



Defining 

g'tsl - C)-‘d = ^ [g^"" 1 + S^s"' 2 + • 



(3-37) 

+ g “l ] > 



analogous to (3.29) and substituting (3-37) into equation 
(3-36) yields 

[1 - f'(-sl - C) _1 d] [1 - f'(sl - C) - 1 d] 

! (3.38) 

= [d'(-sl - C" )gg'(sl - C)d] + I- 

Kalman has shown that a Q constructed from 



Q = gg’ 

will yield the stable control law, f 1 , which satisfies 
theorem 2 and is indeed optimal. That is, the pair [A,g] 
is completely observable. 
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In the above development, since the characteristic 
polynomial is invariant under transformation T, A and b 
can be substituted for C and d respectively in equation (3*38). 

Is the development useful as a design technique? 
Clearly it is not since constructing the proper Q depends on 
factoring ( s ) ^ ( — s ) - V ( s )¥( -s ) . Knowledge of ¥^(s) re- 
quires knowledge of f ' , the vector the design is supposed 
to yield. Hence this development has little practical util- 
ity, but it does provide considerable insight into the com- 
plexities of the problem. 

2 . Multiple-Input Systems 

The following discussion for multiple-input multi- 
ple-output systems presents sufficient conditions which en- 
sure that ' a feedback system will have reduced output 
sensitivity compared to an equivalent open-loop system. In 
one development Perkins and Cruz [17] determine the suffi- 
ciency condition for finite output errors . In a similar 
development, Kreindler [18] proves that the same sufficient 
condition holds for an output sensitivity function. Be- 
cause the derivations are quite similar, they are developed 
simultaneously after appropriate definitions are presented. 

The linear time-invariant system considered is 
described by the state-variable differential equation. 

x = A(q)x + B(q)u . (3*39) 

The plant input, u, can be expressed as an open-loop control 
or a closed-loop control law that is assumed to be linear in 
x. In order that the following comparison be meaningful, it 
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is assumed that initial conditions and external inputs, r, 
to the system are the same for both the open and closed- 
loop systems. Additionally, it is assumed that any varia- 
tions in the plant parameters, q, are the same for both 
systems. The objective here is to ensure that any varia- 
tions in the system output result only from equivalent pa- 
rameter variations. Open-loop and closed-loop systems that 
satisfy these assumptions are considered equivalent systems. 
The equivalent closed and open-loop systems are shown in 
Figure 2 and Figure 3 respectively. 




Figure 2. Closed-loop system configuration. 

Considering the case where the vector q has one 
element q, the nominal parameter value is defined by q = qo . 
The plant input-output transfer function is 

T(s,q) = (si - A) _1 B. (3-40) 
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Figure 3* Open-loop system configuration. 

This definition holds for the identical plants of each of 
the systems under consideration. Figure 2 and Figure 3 can 
be represented in block diagram form by Figure H and Fig- 
ure 5 respectively. The closed- loop outputs and open-loop 
outputs are X Q and X Q respectively. The input notation is 
analogous to this. 




Figure 4. Closed-loop block diagram. 




Figure 5* Open-loop block diagram. 
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The controller G is constructed such that for 

-o 

T = T(s,q ), X (s,q ) = X (s,q ). The problem then is to 
— — o — c o — o o 

study the effects of plant parameter variations on X (s,q) 

“ c 

and X (s,q) under the assumption that the variations are 
identical . 

Prom Figure 

X c (s,q) = T(s,q)[R(s) + FX c (s)] 
or 

X c (q) = [I - T(q)P] -1 T(q)R. (3-41) 

From Figure 5 

X Q (s,q) = T(s ,q)G Q (s)R(s) 
or 

X Q (q) = T(q)G Q R. (3-^2) 

In (3-^1) and (3.^2) and in the remainder of this develop- 
ment the functional dependence on s will not be written for 
notational convenience. 

Assuming that the perturbed parameter q is given 



by 



q = q Q + Aq, 



( 3 - - 43 ) 



then 

T(q) = T(q Q + Aq) . (3*44) 

Clearly the variation of q will cause X c and X q to 
be perturbed from their nominal values. Defining this per- 
turbation as E c and E q for the closed and open-loop cases, 
respectively, then. 
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(3. 45) 



E = X (q ) - X (q + Aq) 

-C -CO -c 

E = X (q ) - X (q + Aq) . (3-46) 

-o -O^O -0^0 ^ 

Using (3*42) E q can be written as 

E q = [T(q o ) - T(q)]U 0 . (3-47) 

Recalling that U is not independent of q, one 

writes 

U c (q) = R + PX c (q) 

= R + F[X c (q) - X c (q o )] + FX c (q Q ) 

U c (q) = U c (q Q ) + P[X c (q) - X c (q Q )]. (3-48) 

Using equations (3*41), (3*45), and (3*48), the 
closed-loop output perturbation can be written as 

E c = T(q o )U c (q o ) - T(q)U c (q) 

= T(q )U (q ) - T(q)U (q ) 

- T(q)P[X c (q) - X c (q o )] (3.49) 

= [T(q o ) - T(q)]U c (q o ) + T(q) FE c 

= [I - T(q)F] _1 [T(q o ) - T(q) ] U c (q Q ) 

E c = [I - T(q)P] _1 E o 

where (3*47) has also been used. 

In equation (3.49), T(q) depends on the parameter 
variation, however for differentially small plant-parameter 
variations (3-49) can be approximated by 

E c = [I - T(q o )P] _1 E o . (3-50) 
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This is the central result of [17]. Observing 
that T(q Q ) = [si - A(q Q ) ]“ 1 B(q Q ) = $(s ,q o )B(q Q ) and substi- 
tuting into (3-50) yields 

E c = [I - $(s,q o )B(q o )P]“ 1 E o . (3-5D 

The term [I - $(s ,q Q )B(q o )F] in (3*51) is similar 
to the scalar return difference and has an interpretation as 
the generalized matrix-return difference [17]. 

Kreindler [18] , instead of defining an output error 
function, defines a sensitivity function 



and 



v c (t) = 3x c (t)/3q = lim e c (t)/Aq (3-52) 

Aq->0 



v (t) = 3x (t)/3q = lim e (t)/Aq (3-53) 

° ° Aq+0 ° 

where the Laplace transforms of v (t) and v (t) arc the vec- 
^ -c -o 

tors V (s) and Y Q ( S ) respectively. With these definitions, 
the following relationship between Y c ( s ) and Y Q ( S ) as °b - 
tained 



Y c ( s ) = [I - f(s,q o )B(q o )F] V 0 (s) . (3-5*0 

Before expressing the conditions under which the 
system sensitivity is reduced, it will be convenient to de- 
fine a new sensitivity variable which under the proper con- 
ditions represents either v(t) or e(t) . The new output 
sensitivity variable y(t) with Laplace transform Y(s) is 
defined such that 

Y c (s) = [I -£(s,q o )B(q o )F]" 1 Y o (s) (3-55) 



or 

Y c (s) = S(s,q o )Y o (s) . 
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sum of the integrals of ^ will have reduced sen- 
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this measure, th t open-loop syst 

, (t)n Ct)dt . »■*) 

f ,.,«»,<*»>•/. l »' 

” , wve de finite weighting ma- 

. t >0, where Z is a post (3 56) implies 

for " theorem, equation ( 3-5 

noins Parseval s «> 
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OO 
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V d -A- 00 
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-o 



i . 

l -J r'7'j VjiH 

Inequality (3-57) ( 3 . 58 ) 

C. (-iu)ZSCjm') - Z <0 

' '. s the inverse of the return dif- 

fer .U*. — 3C 3 m) - ^ postmu it ip i s ing ( 3 . 38 ) « 

ference. Premultiplyi „ ylelds 

- 3u)1 -> and [S.Um)l z >0. «-59) 

L [t .n-j»)SV5t? ' 

‘ ' , db ach control law S « hl ° h S 

„ ult is that any feedback a feed- 
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design systems having reduced sensitivity. They might be 
useful in trial-and-error design but that is not very sat- 
isfying. 

In a development similar to Kalman's [16] , Perkins 
and Cruz demonstrate that the control law F that satisfies 
condition (3 >58) is optimal for single-input linear time- 
invariant regulator systems with respect to the performance 
measure 

J = hj^ [x ' (t)Qx(t) + y 2 (t)]dt . (3-60) 

Kreindler [ 1 8 ] proves the following: 

Theorem 3- For the completely controllable single- 
input linear plant in companion canonic form, for each com- 
ponent Y 1 , i = 1,2, . . . , n , of Yj the following holds 

Y^-(s) = [1 - f '$(s)b]Yj(s). (3-61) 

If in addition f and x = Ax + by are optimal with respect to 
(3*60), then, for all ti>0 




[yj!;(t)] 2 dt < 




[yj(t) ] 2 dt , 



i = 1, 2, 



3 



n . 



( 3 - 62 ) 



This is a useful result. However as Kreindler 
[32] points out it is only applicable for systems in the 
companion canonic form. 

The analysis techniques discussed above are exempt 
from a restriction that the analysis techniques discussed 
subsequently have almost universally: there was no identi- 

fication of the parameter q made, hence, any and all of the 
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variable plant-parameters will exhibit reduced sensitivity 
when the conditions for reduced sensitivity are met. 



C. STATE TRAJECTORY SENSITIVITY 



In general, a plant which is sensitive to perturbations 
of its component values may be characterized in the form of 
equations (3*1) - In the sensitivity analysis of such a sys- 
tem, it is necessary to relate numerically the dispersion 
of the solutions of (3-1) for varying values of the para- 
meters, q. 

Although a great deal of work has been done recently 
in the area of state trajectory sensitivity, few important 
general results have been discovered. Most of the design 
techniques that are discussed in the literature result from 
application of the sensitivity equation [3, 13] , obtained 
by taking the partial derivative of equation (3-1) as fol- 
lows : 



3 

3 *i 


r dx' 

[dtj 


3 

-aq ± 


[ a(x(t) 


,u(t) 


,q(t ) ,t ) ] 






'dx^ 


3a 


3x 


3a . 


3 u 3a 


3q 


d 






• + 


. i. - • 




3q ± 


dt 

^ J 


3x 


3q. 


3u 


3q. 3q 





The form of the matrix of partial derivatives, 3a/3q, is de- 
fined by 



3a 



3 3 



ij 



3a. 

*7 



i = 1 , 2 , . . . n 
J — 1,2, ...r. 



(3.64) 



The matrices 3a/3x and 3a/3u are dimensioned nXn and nXm 
respectively and are defined in a manner analogous to (3-64). 
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The form of the vector of partial derivatives, 3x/3q i , is 
defined by 




3x x N 

3qJ 

< . > 



3x 

n 




(3.64a) 



The vectors 3u/3q^ and 3q/3q^ are m and r-vectors respec- 
tively and are defined in a manner analogous to (3.64a). 

If 3x/3q^, 3x/3t, and 3x/3q^ are all continuous func- 
tions of q and t, the order of differentiation can be in- 
terchanged and 



3 


'dx 1 


d 


3x 


9 ^i 


dt 


dt 





(3-65) 



The sensitivity function (influence coefficient) s^(t) 
is defined by 

3x(t ) 

s.(t) = 7 " for all x and q., (3*66) 

dQ. — 1 



i = 1,2 



.r . 



Using equation (3*64) and definition (3*65) » equation 
(3-63) can be written more compactly as 



s . 

-1 



33. 33 3u 33 3q 

3x -i + 3u 3q7 + 3q * 3q7 



(3.67) 



Since in section B it was shown that feedback control 
frequently can provide reduced sensitivity over the equivalent 
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open-loop system. It is assumed that a control law of the 
form 



u ( t ) = u [ X ( t ) ] 



( 3 . 68 ) 



is specified. Under this assumption 3u/3q^ can be written 



as : 



3u 



3u 3x 



3u 



s . . 



3q i 3x 3q 1 3x -i 
Using (3*69), (3.67) can be written as 



s . = 

-1 



3 a 3 a 
3x + 3u 



3u 

3x 



3a 3q 

c? 4- • 

-i 3 q ' 3q ± 



(3.69) 



(3.70) 

y 1 — 1 ) • ‘ 3 ^' 



Rewriting (3-70) > where the meaning of Ai(t) and a).(t) is 



-1 



( O 71 ^ 
\ u • l J 



obvious 5 yields 

Ift) = Aj(t)s 1 (t) + w.(t), i = l,...r 

Equation (3*71) is the vector notation for nr equations each 
having the form 



d 


f3x.l 
1 


n 

= £ 


9a . 

' 




n 

v 


dt 


3q . 

ij 


k=l 




3q. + 


k=l 






. 3x k 


r 

■ + T. 


.3a . 
— 1 • 


9q k 



m 

I. 



3 a . 

3^ 



3u . 



3x 



3q ± k=l 3q k 3q ± 



k 



(3.71a) 



where 3q k /3q^ = 



1 if i = k 
0 otherwise. 



In several equations above for convenience in notation, 
function arguments were omitted. This practice will prevail 
throughout this section. 
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Since it is assumed that the parameter variations have 
no effect on the initial conditions of (3.71) > 

s 1 (t 0 ) = 0. (3.71b) 

In order to obtain the sensitivity function defined by 
(3.7D) the values for Ai(t) and y 1 (t) must be determined. 
This amounts to evaluating the partial derivatives 3a/3x, 
3a/3q, 3a/3u, 3u/3x, and 3q/3q^. This can be done for the 
specific optimal control problem under consideration. 

The optimal control is the admissible control, u*(t), 
which causes the system 

x(t) = a[x( t) ,u(t) ,q( t) ,t] (3-D 

x(t 0 ) = c 

to follow an admissible trajectory, x(t), that minimizes 
the cost functional 

f tf 

J = h[x(t f ),t f ] + J f [x(t) ,u(t) ]dt (3-72) 

fc o 

while transferring the state of the system from a given ini- 
tial position x(to) = c to some final position x(t^) = x^, 
that is restricted to some (n + l) dimensional subset T of 
state-time space. T is called the target set. Here, the 
optimal control is constrained to the feedback form 

u*(t) = u[x*(t)] , (3-73) 

where u* and x* are the optimal control and trajectory re- 
spectively . 






Returning to consideration of the partial derivatives , 



3a/3x, 3a/3u, and 3a/3q are all functions of [x(t),u(t), 
q(t),t], However, using (3-73)? the explicit dependence on 
u(t) can be eliminated and then the partial derivatives be- 
come functions of [x(t) ,q(t) ,t] . The value q(t) = §(t) 
defines the point in parameter- time space at which the par- 
tial derivatives are to be evaluated. Additionally, it is 
noted that 3u/3x is also a function of x(t) and therefore, 
because of feedback, implicitly a function of q(t) . Upon 
specification of q(t) the differential equations (3*71) with 
their initial conditions ( 3 * 71 b) can be solved for the sen- 
sitivity function, s^(t). If small parameter variations are 
assumed the partial derivatives can be approximated by let- 



It would be well at this point to summarize the devel- 
opment . 

For the dynamical system 




x(t) = a [x(t ) ,u(t) ,q(t) ,t] 



(3-D 



x( to ) = c 



the optimal control 



u*(t) = u[x*(t)] 



(3-73) 



minimizes 



J = h [x( t f ) ,t f ] 




t 



o 



The trajectory sensitivity with respect to the para- 



meter is 



3x(t ) 

5i (t) ' 



for all x and q^, i 



= 1 , 2 r (3-66) 



and is the solution of 



s^t) = Ai(t)s i (t) + w i (t), 



(3.7D 



where 



A i ( t ) - 



3a 3a 3u 

3x + 3u 3x 



(3-7*0 



q = q o 



and 



3a 3q 

0) . ( t ) = ^ ‘7T — 

-l 3q 3q. 



(3-75) 



q=q 0 



Chan and Chuang in [33] obtain a similar result by 
expanding the right-hand side of (3-1) about [x,qo ,u(x) ,t] 
in a first order Taylor's expansion. They obtain 

dz/dt = A ! ( t ) z + B(t)T(t) (3-76) 

z(0) = z 0 

where z. = x* - x* is the i^h component of the variation 

along the optimal trajectory, and y. = q. - q. is the 

1 1 3 ^ 

variation of the parameter q^ about its nominal value. The 
matrix Ai(t) is defined as in (3-7*0, B(t) is 

B(t) = 3a/3q, (3-77) 

and the partial derivatives in (3-76) are evaluated along 
the optimal trajectory. 

Writing the i^h equation of (3-76) in expanded form 



yields 



*t 3 



dz . 
dt 



3a. 



n 

kll 



3a . 
3x 



m 

E. 



k t=i 3u « 



ih 

3x 



k 



J k 



r 9 s.. 

+ k=l 3q^ Y k 



(3-78) 



Dividing both sides of ( 3 « 7 8 ) by y^ yields 



d 


(x . - x . ) 
J jo' 


n 

— y 


3 ci . 


m 3a . 

y , 


3u £ 


dt 


Y i 


k=l 


3^ + 


£=1 3 u £ 


9x k 



(x k - 

n 



r 3a . 

E. — • 



Y 



x 



k=l 3q k y ± 



(3-79) 



In the limit as y^->-0 equation (3-79) becomes 



3Xj 


n 


3a . 


m 


3a^ 




3x k 






'Y . - 




*\ * 


0 Q . 


/V — JL 


O w, 

k 




ou £ 


O A, 

k 


aq. 



r 3a. 3q, 

+ E — • — — 
k=l 3q k 3q._ 

which is identical to equation (3. 71a). 

It is important to note that the sensitivity equation 
derived above is always linear; this is true even though the 
dynamic system (3*1) may be nonlinear; therefore, equation 
( 3 * 71 ) is always a system of linear ordinary differential 
equations with constant or variable coefficients. It should 
also be noted that (3-71) is not valid for the case in which 
g can vary in such a manner as to change the order of the 
state equations [8] . In most applications the parameter 
vector, q(t), is assumed to be a slowly-varying time func- 
tion that can be approximated by the constant parameter 
vector, q. hb 



1 . Linear System State Trajectory Sensitivity 



In this section the state trajectory analysis 
above will be applied to a linear state regulator system. 
The results of this development will be used extensively 
in following chapters. 

The linear regulator system is described by the 
state equations 



x(t) = A ( t ,g ) x( t ) + B(t,q)u(t) 
with a linear feedback control law of the form 



( 3 - 80 ) 



u(t) = F(t)x(t) 



( 3 . 81 ) 



A(t) is the real, time-varying, nXn system matrix. 
B(t) is the real, time-varying, nXm distribution 
matrix . 

P(t) is the real, time-varying, mXn gain matrix. 

u(t) is the control m-vector. 

x(t) is the state n-vector. 

g is the constant parameter r-vector. 



Assuming that the solutions to (3-80) are analytically de- 
pendent on the parameters q, the partial derivative of 
(3-80) with respect to parameter q^ is 



( 3 . 82 ) 



d 

dt 



9x 

9q“ 



8 A 



9x 



9B 



9u 



9q ± - 



x + A 



- 3q. 



3q ± - 



u + B 



- 3q, 



Defining, as before, 




(3.83) 
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and using (3*81), the sensitivity equation ( 3 • 82) can be 
written mere compactly as 

8u 

s. = 9A . x + 9B.u + As. + B ~ — . (3*84) 

-l -l- -l- --1 - 9q. 

l 

Taking the partial derivative of (3*81), where it is assumed 
that F is not a function of q^, yields 



9u 

-5 = Fs . 

9q. — 1 



(3.85) 



Using (3-85) another useful form of (3*82) is obtained. 



s. = [ 9A . + 9B . F ] x + [A + BF] s . , 

-1 L -1 -i- J - - — J -i 5 



( 3 . 86 ) 



where the meaning of 9A^ and 9B^ is clear from (3-67) and 

( 3 . 82 ). 

D. PERFORMANCE SENSITIVITY 



In a design procedure in which the ideal controller is 
optimal for a wide range of parameter variations, Rohrer 
and Sobral [27] define a new sensitivity function, the 
"relative sensitivity" of u(q,t) at parameter "operating 
point" q. This relative sensitivity is expressed by 



S r (u,q) 



J (u,q) - J*(u*,q) 
J*(u*,q) 



(3.87) 



where u*(q,t) is the optimal control such that 



J*(u*,q) = minJ(u,q), 
u 



subject to constraints 

x(t) = a [x( t ) , u ( t ) , q , t ] . 



( 3 . 88 ) 
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(3-D 



Among the advantages cited for the use of such a per- 
formance sensitivity is that it is always positive. Addi- 
tionally when the parameters q are such that u=u * 3 S r (u,q)=0. 
This provides a measure against which system performance can 
be compared. 

The design technique proposed consists of a minimaxi- 
mization of the relative sensitivity with respect to u and 
q. The procedure consists of assuming a design criteria 
which defines the plant sensitivity SP(u). Two suggested 
plant sensitivities are 



and 



SP(u) = max 

q 



s r (u 3 q) 






T? 

-LJ 

q 



C ^ ( n n ^ 



(3.89) 



(3.90) 



where E [•] indicates expected value. The design procedure 

/s 

then consists of choosing u such that 



SP(u) = min 
u 



SP(u) 



(3.9D 



In a second-order example with a single variable parameter, 
Rohrer and Sobral demonstrate that the use of "relative 
sensitivity" in conjunction with (3-89) yields a system that 
has reduced sensitivity and remains close to the optimal 
over the entire range of parameter variations. 

Salmon [28] presents a new algorithm for the global 
solution of a minimax problem. The algorithm converges to 
the global solution in the presence or absence of saddle 
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points. The class of optimization problems for which the 
algorithm applies includes those having quadratic perfor- 
mance measures with linear time-invariant state equations 
and a constant gain linear control law (the infinite inter- 
val problem described by Kalman [3])* 

In two examples, Salmon applies the algorithm using 
the Rohrer and Sobral "relative sensitivity" and the "abso- 
lute sensitivity," 

S a (u,q) = J(u,q) - J*(u*,q), (3-92) 

in each. 

In the first example, which is the same as that used 
by Rohrer and Sobral, the performance using "relative sen- 
sitivity" exceeded the optimal performance by less than 1.9 
percent for all allowable values of q. The performance 
using "absolute sensitivity" exceeded the optimal perfor- 
mance by about 50 percent for q = 0, the minimum allowable 
value of q. 

In the second example, the control objective is to 
maintain the spacing among a string of three electronically 
coupled vehicles. The five state variables are the three 
vehicle velocities, and the two spacings between the center 
and end vehicles. The performance measure is the infinite- 
time integral of a quadratic form involving vehicle spacing 
deviations and control. In this example with nine variable 
parameters, the "absolute sensitivity" technique provided 
performance closer to optimal than did the "relative sensi- 
tivity" technique. This was to be expected since it is more 



important that the controller be close to ideal when the 
performance measure, J(u,q), is large. 

Another feature of design techniques using "absolute" 
or "relative" sensitivity is that the structure of the con- 
troller must be specified by the designer. Hence, the 
technique is amenable to solution of the de-sensitized out- 
put regulator problem. 

The minimax design technique, whether using "relative 
sensitivity" or "absolute sensitivity" apparently has ad- 
vantages of considerable value to the designer. However, 
there are also disadvantages. Minimax algorithms are dif- 
ficult to implement except for restricted classes of prob-. 
lems . Additionally, the solutions obtained are dependent 
on the initial condition: hence, the solution is only 
valid for that initial condition. In general, the solution 
obtained by minimax design will be optimal for only one 
initial condition. 

Ozer [3^] applies a minimax algorithm to the solution 
of the output regulator problem. He defines an auxiliary 
performance measure which takes the forms (3-87) and (3*92) 
among others. With a second-order example he demonstrates 
that the controllers obtained by the two methods differ 
widely. The problem is solved for several initial condi- 
tions and is used in an excellent discussion of the effects 
of initial conditions on performance for several auxiliary 
performance measures. 



E. SUMMARY 

In Kalman's development, it was shown that for the 
completely controllable single input plant 

x(t) = Ax( t ) + by ( t ) (3-7) 

and performance measure 



J(R) 




[x'Qx + y 2 ] dt 



(3.14) 



the optimal control law 

y*(t) = f'x(t) (3-93) 

satisfies the condition 

|1 - f'<J>(jw)b|>l. (3-22) 

He also proved the inverse theorem: if a stable control 

law f satisfies (3-22), then it is optimal for a perfor- 
mance measure (3.1*0 with some Q. Given the f one can find 
a Q by spectral factorization of a rational function. 

An important result is that every optimal system of 
the form of ( 3 . 7 ) , (3.1*0 s and (3*93) will exhibit reduced 
sensitivity compared to an equivalent open-loop system. 
Perkins and Cruz defined a sensitivity matrix 

S(s,q) = [I -$(s,q)B(q)F] -1 . 

The inverse of this matrix was interpreted as the generalized 
matrix-return difference. Their central result was that con- 
stant feedback control laws, F, for linear state regulator 
systems (3*39) that satisfy the condition 
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(3-58) 



S' (-jw)ZS( jo) - Z < 0 

for all to, will provide reduced output error compared to 
the equivalent open-loop system in the sense that an inte- 
gral inequality of the type (3.56) will hold, for t > 0. 

Kreindler with parameters restricted to differentially 
small variations obtained the same result for the output 
sensitivity function (3-52) and (3-53)- He also showed 
that for systems in the companion canonic form satisfying 
(3-58), the sensitivity measure (3-56) reduced to the form 
of (3.62). This result implies that the sensitivity of each 
state trajectory in the closed-loop system was less than the 
sensitivity of the corresponding open-loop state trajectory. 

State trajectory sensitivity analysis was approached 
by means of the sensitivity function defined by Miller and 
Murray. A sensitivity differential equation was derived 
which was linear even though the system model could be non- 
linear. The sensitivity differential equation was made 

explicit for linear state regulator systems as 

3u 

s. = 3A.x + 3B.u + As. + B -r . (3-8*0 

-1 -1- -1- — 1 - 3 q^ 

Rohrer and Sobral introduced a new "relative sensi- 
tivity" performance measure that defines a minimax problem. 
The technique is applicable with large parameter variations. 
Salmon provided a minimax algorithm that could be used to 
solve problems using "relative sensitivity." However, by 
means of an example he demonstrated that for some problems, 
better results are obtained by using "absolute sensitivity" 
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for the performance measure than was obtained using "rela- 
tive sensitivity." It was pointed out that the dependence 
on initial conditions severely limits the utility of these 
minimax schemes. 
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IV. TRAJECTORY SENSITIVITY DESIGN 



A . GENERAL PROCEDURE 

In the previous chapter, an expression for the tra- 
jectory sensitivity of a general feedback system to plant- 
parameter variations was developed. In this chapter that 
expression will be used in the development of an optimiza- 
tion problem that includes sensitivity constraints. 

The objective is to use the trajectory sensitivity 
analysis technique previously established in formulating an 
optimization problem that will result in the design of con- 
trollers that are optimal in some sense and at the same 
time provide trajectory insensitivity to plant parameter 
disturbances . 

Equations (3*66), (3*71)* (3*7*0* and (3*75) are re- 
peated here for convenience: 

3x(t ) 



S . (t ) _ 5 i 1*2*... *r 

-l 6 q^ 


(3*66) 


s ± (t) = Ai(t)s i (t) + w i (t) 


(3*71) 


(to) = o 






3a 3a 3u 

- 1 - 3x + 3u 3x 


IiQ 

II 

o 


(3*7*0 


3a 3q 

2i (t) ■ Dq • aa. n . n 

- 'i q-qo 


(3*75) 
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By adjoining equation (3-71) to equation (3-1) the n(r+l) 
augmented state vector z is 



/x(t) \ 

Sj(t) 



u r (t )) . 

The corresponding initial condition vector is 



(4.1) 



/c\ 

0 



z(t 0 ) 








J 



The augmented system then is defined by 



(4.2) 



z(t) 



f a [x(t) ,u(t) ,q ( t ) ,t ]> 

A 1 ( t ) S 1 ( t ) + 03 1 ( t ) 




\,Ai (t)s r (t) + w r (t ) J 



(4.3) 



or more compactly as 



(4.4) 

z(t) = d[x(t) ,si (t) . . . .s r (t) ,u(t) ,q(t) ,ui ( t) . . .oj r (t) ,t] . 

Following the procedure of Kahne [19] a new performance 
measure that includes a scalar sensitivity term 
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( 4 . 5 ) 



[f (x(t) ,u(t) ) + g(si (t) . . . s r ( t) ) ]dt 
o 

is defined. 

Applying Pontryagin's minimum principle [2], the 
Hamiltonian is given by 

H[z(t) ,u(t) ,p(t) ,q( t) ,t] = f ( • ) + g(-) + p ' d( • ) j (4.6) 

where p(t) are the Lagrange multipliers. 

The necessary conditions for unconstrained u(t) to 
minimize the performance measure (4.5) are 

z*(t) = [z*(t) ,u*(t) ,g*(t) ,q(t) ,t] 

‘ 2*( fc ) = “ ff- [z*(t) ,u*(t) ,p*(t) ,q(t) ,t] (4. 7) 

0=|^ [z*(t) ,u*(t) ,p*(t) ,q(t) ,t] 

for all t <t<t„, where t„ is fixed and x(t~) is free. The 
superscript (*) denotes optimal. 

There is no guarantee that a solution to the above 
problem exists. 

Considering the performance index (3*72), the con- 
troller obtained above will be suboptimal. A tradeoff be- 
tween optimality with respect to ( 3 * 72 ) and sensitivity 
reduction will actually occur. 

B. LINEAR REGULATOR SENSITIVITY DESIGN 

In the preceeding section an optimization problem was 
defined and a method of solution outlined that resulted in 



= h[x(t f ) 



t f )] + 



/ 
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a control that was optimal in the sense that a performance 
measure which included sensitivity terms was minimized. 

There is some question concerning the existence of the solu- 
tion proposed. In this section the procedure will be ap- 
plied to the linear regulator problem. The solution to 
this problem exists and can be obtained following the for- 
mulation of Athans and Falb m. 

The linear time-varying state regulator system is de- 
fined by 

x(t) = A(t ,q)x( t) + B( t ,q)u( t) (4.8) 

x(t Q ) = c . 

Rewriting equations (3*83) and (3-84) here for convenience 




( O 



\ ^ • 



/ 



s . 

-l 



9A . x + 

-l- 



9B . u + As . 

-l- — l 



+ B 



9u 

9qT 



(3.84) 



s . ( t ) = 0 
-l o 



The rn vector s is defined by 



s = 



V 



< > • 



s 

\- r / 



(4.9) 



The partial derivatives are evaluated at q o , the nominal 
value of q. (Function arguments have been dropped for no- 
tational convenience.) Referring to (3-82) and (3*84), 
the matrices 9A 1 and 9B i are defined by 
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( 4 . 10 ) 



and 



3A. 

-l 



3B. 

-l 



3A 

8qT 



3B 

^q7 



(4.11) 



Higginbotham [23] writes the partial derivative of 
u = u(x,si s s 2) .. .s ,t) with respect to q^ as 



3u 



3u 3x r 3u 

3x 3 q . + j = 1 3 s . 

d -j 



3 s . 



8 «i 



Substituting equation (4.12) into (3-64) yields 



s i = 3A i- + 



3u 

^ + § 37 



x 1 9 u 

s. + 3B.u + B .2, -r 

-l -l- - j =1 3s . 

-J 



(4.12) 



3s . 



3t >i 



(4.13) 



or 



s. = 3A.x + As. + 3B.u + e. . 

-1 -l- — i -l- ~i 



(4.14) 



It has been assumed that the resulting controller will 
be a feedback controller of the states and sensitivity 
functions. This result will be demonstrated. It has been 

further assumed that the partials 3u/3x and 3u/3s. are 

” J 

evaluated at q=q Q . 

Proceeding as before, equations (4.14) are adjoined 
to equations (4.8) to form the augmented system 



s 1 

•XI 1 




1 

1 

<1 1 
1 


0 


0 


O 1 






X >| 




(~) 






S 1 




1 CL? 1 

1 l> 1 

1 - 1 

1 1 


A 

A 


o 


. . . o 




£ 1 




3§i 






1 ICO. 

1 N> 


>- < 


9A 2 


0 


A 

A 


. . . o 


X 


s 2 




3B 2 


/ U +\ 


— 2 



























• 




• 


• 


• 


• 






. 








; 


ir. 




^ A -r 


o 


• 

o 


• 

A 

... a; 






-r> 
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which can be written more compactly as 



z = A j z + B u + e 



(4.16) 



M 

o 



z(t ) = z = 

- o -o 



< 






0 

W 



where the meanings of z, A 1? B 1} and e are clear from (4.15) 
The quadratic performance measure, J, is 



J = \x' (t f )Dx(t f ) + %s ’ (t f )Es (t f ) 



■/ 



(4.17) 



-2 i [x'(t)Q(t)x(t) + s'(t)W(t)s(t) + u’(t)R(t)u(t)]dt 

"t 



where the terminal time t^ is specified and 

j. 

E is a constant rnXnr positive semidefinite matrix 

D is a constant nXn positive semidefinite matrix 

Q(t) is an nXn positive semidefinite matrix 
W(t) is an nrXnr positive semidefinite matrix 
and R(t) is an mXm positive definite matrix. 

The performance measure (4.17) can be rewritten in terms of 
z as 



J = hz,' (t f )Diz(t^) + h\ [z'QiZ + u'Rujdt 



■J 



(4.18) 



where 



D = 
- i 



D 

0 



, (r+l)nX(r+l)n 



(4.19) 
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(r+l)nX(r+l)n. 



(4.20) 




By applying Pontryagin’s minimum principle, the neces- 
sary and sufficient conditions for the optimal control are 
obtained . 

The Hamiltonian, H, for (4.16) and (4.18) is defined 
as follows 

H = ^ [z'QjZ + u’Ru] + p' [AjZ + Bj^u + e] (4.21) 

where p(t), the (r+l)n costate vector, satisfies the dif- 
ferential equation 

E - - ff <‘••2®) 

or 

E = - QjZ - A }p . (4.23) 

The unconstrained optimal control must satisfy the 
equation 

^ = 0 (4.24) 

or 

Ru* + B ' p = 0 . (4.25) 

_ i_ 

Solving (4.25) Tor the optimal control yields 

u* = - R _1 Bjp . (4.26) 

In order to express u* in the specified form of equa- 
tion (3-81) substituting (4.26) into (4.16) yields 



which when combined with (4.23) forms the augmented system 







(4.28) 



This is a system of 2(r+l)n differential equations. In 
order to solve them, 2(r+l)n boundary conditions are re- 
quired. The first (r+l)n boundary conditions are defined 
by equation (4.16) 



z(t 0 ) = 




(4.29) 



The remaining boundary conditions required are final 
conditions for the co-state equations. They are obtained 
from the transversality conditions (see Table 5-1 of [4]), 
with fixed terminal time, t^., and z(t^) free 




where 4Kt^,t) is the transition matrix for the system (4.28). 

Partitioning ^(t^,t) into four (r+l)nX(r+l)n submatrices 
yields 
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$(t f »t) 



(4.33) 




Substituting (4.31) into (4.32) yields 




(4.34) 



dx. 



Performing the indicated matrix multiplication yields 




Performing additional algebra 



-1^—11- ^12- 




2i^ll(t 3 T )e( T )dx 




-2l( t jT)e(x)dT 



[^22 — 1 — 12 ^— ^ — 1—11 $ 21 -^ - 



/*t f 

i ^ 



+1 D.^ 11 (t,x)e(x)dx -I ^ 21 (t ,x)e(x)dT 

't •'t 



61 



yields 



, - 1 



p(t) = [^ 22 (t fJ t) - P 1 ^ 12 (t f3 t)] 



(4.36) 



{j-l^ll^f *t)"i 2 i( t f » t ) 3 z( t ) + J* [D 1 i 11 (t 3 T)-^ 21 (t 3 r)]e(r)drJ 



Equation (4.36) is the desired result; it relates p(t) 
and z(t) 3 and with (4.26) yields the optimal feedback con- 
troller. Kalman [3] has proved the existence of the in- 
verses in (4.36) for all t, t Q <t<t f . 

Writing (4.36) more compactly 

p(t) = K(t)z(t) + v(t) (4.37) 

and substituting into (4.26) yields the optimal control 

u*(t) = -R _1 (t)B’ (t) [K(t) z(t) + v( t ) ] (4.38) 

where (4.39) 

K(t) = [$ 22 (t f ,t) - P 1 i 12 (t f ,t)]" 1 [p i ^ 11 (t f3 t)-^ 21 (t fJ t)] 

and 

v ( t ) = [$ 22 (t f ,t) - P 1 <t 12 (t f a t)]" 1 . 




- '$ 21 (t ,x)]e(T)dx. 



(4.40) 



Since (4.39) and (4.40) are extremely difficult to 
evaluate 3 a simpler expression would be helpful. Again fol- 
lowing [4] the time derivative of (4.37) yields 



p = Kz + Kz + v . 



(4.41) 
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From (4.27) 



z = A j z - Mp + e 



(4.42) 



where 



M = BjR 1 3 ' 



(4.43) 



and from (4.23) 



p = - QjZ - A Jp . 

Substituting (4.37) into (4.41) yields 

z = [Aj - MK] z-Mv+e. 
Substituting (4.43) into (4.40) yieldA 

g = [K + KA - KMK] z - KMv + Ke + v. 
Substituting (4.37) into (4.23) yields 

A - _ A 11^1 rr _ Alu 

£ L ^ i - l — J - -l- 

Subtracting (4.46) from (4.45) yields 

[K + KAj - KMK + AJK + Qjz + v+ [A ’ K - KM] v + Ke 

If the optimal solution exists, equation (4.47) must 
hold for all z(t), v(t), e(t) and t. Therefore 

K ( t ) = - K(t)Aj(t) - A’(t)K(t) + K( t)M( t)K(t) - (4.48) 

and 

v(t) = - [A j(t)K(t) - K(t)M(t)]v(t) - K(t)e(t) . (4.49) 

The boundary conditions for (4.48) and (4.49) are found 
as follows. Equation (4.37) evaluated at t=t^ yields 

p(t f ) = K(t f )z(t f ) + v(t f ) . (4.50) 

Equation (4.31) is repeated 

p(t f ) = D 1 z(t f ) . 
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(4.23) 

(4.44) 

(4.45) 

(4.46) 

(4.47) 
= 0 



(4.31) 



Since (*1.31) and (*1.50) must hold for all z(t^), it 
follows that 

K(t f ) = Dj 

and 

v(t f ) = 0. (*1.52) 

Having obtained the desired control law (*1.38), the 
partial derivatives of (*1.12) can be further evaluated. 
Performing the multiplication indicated in (*1.38) yields 

u* = - R _1 BJ [K x x + K 2 S! h- . • .K r+1 s r + v] (*1.53) 

where the matrix is the i ^ (r+l)nXn column partition of 

K. The partials of u with respect to x and s. are 

J 

9u/3x = -R~ 1 B { K j ( *1 . 5*1) 

and 

du./zs. = -R -1 B;K j+1 (*1.55) 

respectively . 

It should be noted that this result implies that the 
matrix A x (t) in the Riccati-type differential equation ( *1 . *1 8 ) 
contains elements of K(t) . That is from (*1.15) 

A ( t ) = A - BR _1 B'K 1 . ' (*1.56) 

. Thus the optimal controller utilizes state variable 
and sensitivity function feedback. An additional forcing 
function^ v(t), that might be considered the sensitivity of 
the sensitivity function is also an input . 

Figure 6 is a block diagram of the system with its feed- 
back controller that results from the sensitivity-constrained 




Figure 6. Block Diagram of Sensitivity Constrained 
Linear Regulator System. 
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design procedure derived above. It is clear that the deriva- 
tion yields an extremely complex control strategy and any 
simplifications that can be made would be extremely desirable. 
Figure 6 assumes v(t) and s(t) are available, they must, of 
course, be synthesized. 

The sensitivity vectors can be generated from the vec- 
tor differential equation (4.13) with the state vector and 
control vector as forcing functions. However, the open-locp 
input v(t) is not so easily generated because the initial 
conditions for equation (4.49) are unknown. These functions 
depend on the partial derivatives of the sensitivity vec- 
tors with respect to q^, the unknown parameters. The solu- 
tion of (4.49) then depends on x(t) and hence is dependent 
on initial conditions. Consequently v(t) must be computed 
off line for the desired trajectory, x(t), and can be used 
only for that traj ectory . 

The controller described cannot be implemented in the 
linear regulator system in which the initial conditions are 
unknown. In order to implement it for a system with the 
trajectory, x(t), v(t) must be determined off-line by solving 
a two-point boundary- value problem consisting of (2r+3)n 
first order differential equations. Even though the equa- 
tions are all linear, this is not a trivial task. 

In the following sections, two design techniques that 
are simplifications of the above are considered. The first 
due to Cassidy and Lee [22] neglects the e^(t) term of equa- 
tion ( 4 . 1 4 ) . The second due to Kahne [19] assumes the matrix 
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B(t) is not a function of q. Kahne also completely neglects 
the entire term 3u/3q^ in equation (3-84). 

C. THE CASSIDY AND LEE CONTROL STRATEGY 

Cassidy and Lee [22] presented a new control strategy 
derived from an optimization problem that considered the 
reduction of trajectory dispersion due to plant parameter 
variations. Their development was much the same as that of 
section B except that they neglected the effects of the 
term e(t) in equation (4.16) and considered only the case 
where there is a single input. Their results, extended to 
multiple inputs, are presented here as a variation of the 
development of section B. 

The linear time-varying state regulator system is de- 
fined by equation (4.8) with its accompanying definitions 



The sensitivity functions and equations of chapter 
III are repeated here for convenience. 



x(t) = A(t,q)x(t) + B(t ,q)u(t) 



(4.8) 



= Sx/Sq^ 



(3-83) 



and 



s. = 3A.(q)x + A(q)s. + 3B.(q)u + B 3u/3q. (3.84) 

”1 ”1 ~ “1 ”1 - "" 1 




where 



3A ± = SA/Sqj^ 



(4.57) 



q=q 



-o 



3B ± = 3B/3 qi 



(4.58) 



q=q 



-o 
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Anticipating the resultant controller, u(t) is defined 
by 

u(t) = F(t)x(t) + i | 1 F i (t)s i (t). (4.59) 

Writing the partial of u(t) with respect to and 
ignoring second partials, yields 

9u/9q ± = F(t)s ± (t) , (4.60) 

where F(t) is not a function of q^ . 

Substituting equation (4.60) into (3*84) yields the 
sensitivity equation used by Cassidy and Lee 

s. = 9A . x + (A + BF)s. + 9B.u (4.6l) 

-l -l- - — -l -l- 



s i (t 0 ) = 0. 

Again function arguments, once specified, are dropped 
for notational convenience. 

Proceeding as in section B- adjoining the sensitivity 
equations to the plant equations yields the augmented sys- 
tem (4.15) except that the last term has been eliminated 

A 

and A= A + BF. Rewriting equation (4.16) with the vector 
e(t) eliminated yields 



z = A i z + B i u 
z( to ) = (c ' ! 2'} 



(4.62) 



where the meanings of z,Ai, and Bi are clear from equation 

A 

(4.15) and the definition for A above. 

The performance measure for this problem is identical 
to the performance measure (4.18) 
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J = Jgz 



(t f )D^ z(t f ) 



'/ 



[z'Q z 



+ u'Ru]dt 



(4.18) 



where D 13 Qj , and R are as defined In section B. 

The solution to the optimal control problem defined by 
dynamic system (4.62) and the performance measure (4.18) is 
well known. It can be obtained in a straightforward manner 
following the derivation of section B. The result is stated 
here . 



The optimal control for (4.18) constrained by (4.62) is 
u*(t) = -R - 1 ( t ) B ’ (t)K(t)z(t) (4.63) 



where K(t) is the symmetric positive definite solution to 
the Riccati matrix equation 



K 



-A'K - KA + KB R *B ’ K - Q 

-i- — l — i- -i- -i 



f lr 
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\ 

) 



K(t f ) = Dj. 



The matrix K(t) is an n (r+l)X(r+l)n square matrix. If K(t) 
is partitioned into (r+1) matrices each of dimension 
n(r+l)Xn, then K^,i = l,...,(r+l), is the i th n(r+l)Xn 
column partition. Using this notation 

u* = -R - 1 B 1 [K x + ,L K s ]. (4.65) 

1 O J- o ■J- o 

It should be noted that P = and consequently the 

matrix A in (4.64) is a function of elements of K. 

Equation (4.65) is identical to the feedback term of 
equation (4.53)> the optimal controller for the problem of 
section B. The elimination of the open-loop term is an im- 
portant simplification* this controller can be implemented 
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more easily. The block diagram of Figure 6, with the open- 
loop eliminated, shows the structure such a controller could 
take . 

Kalman [3] has shown that if the pair [A 1 ,B 1 ] in (4.62) 
is completely controllable, if D, = 0 in (4.18), and if 
AjjBjjQi, and R are constant matrices, then K(t)->-K (a con- 
stant matrix) as t f -*». Clearly if these conditions are met 
the Cassidy and Lee result can be extended to include the 
infinite-time constant feedback controller. This is an 

important engineering result since the matrices F and F., 

<3 

j=l,...,r, in equation (4.59) are constant matrices, con- 
sequently their implementation would be very simple. 

Under the conditions above, K = 0 and equation (4.64) 
becomes 

0 = - A'K - KA i + KB x R _1 B|K - Q 1 . (4.66) 

D. THE KAHNE CONTROL STRATEGY 

In his paper "Low Sensitivity Design of Optimal Linear 
Control Systems" [19], Kahne has proposed a design technique 
for the linear regulator problem that is similar to that of 
the previous section. As a further simplification however, 
Kahne treats the problem in which the distribution matrix, 
Bi(t-), is not a function of the parameters, q. Additionally 
Kahne neglects the term 9u/3q^ entirely. He evaluates all 
partial derivatives at q=q o , the nominal parameter values. 

With these assumptions, the system and sensitivity constraints 
are defined by 
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x(t 0 ) = c 



and 

s ± (t) = 3A ± (t ,q)x( t) + A(t i q)s 1 (t) (4.68) 



s i ( t o ) = 0 

The sensitivity equation (4.68) is obtained by taking 
the partial derivative of (4.67) with respect to q^, under 
the assumptions stated above. Kahne ' s development con- 
sidered only a scalar parameter qi. He hinted that exten- 
sion to multiparameters is only a notational problem. The 
extension to r parameters is indicated here. 

The vector s^(t) is defined by equation (3*83); the 
matrix 3A^(t,q) is defined by 



3A 1 (t,q) = 3A(t,q)/3q 1 . 



(4.69) 



The vectors, x(t) and u(t), and the matrices A(t,q) and 
B(t) are the same as those previously defined for (4.8). 
The augmented system is defined as 
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which can be written more compactly as 



z = A i z + B i u 
z( t 0 ) = Zo • 



(4.7D 



Kahne defines the problem for low sensitivity design 
as follows: 

Find the admissible u*(t) that minimizes 



J 



hz' ( t f )D i z( t f ) + 




(4.18) 

[z 1 (t)Q x (t) z(t) + u ' ( t )R( t ) u( t ) ] dt 



subject to the constraints of (4.71)? where D l9 Q , and R are 
as defined in section B. 

This optimization problem has the same form as that of 
section A. Again the solution is well known. 

The optimal controller is 

u*(t) = -R -1 (t)BJ (t)K(t)z(t) (4.72) 

where K(t) is the symmetric positive definite solution to 
the Riccati matrix differential equation 

K(t) = - AJ (t)K(t) - K(t)A x (t) (4.73) 

+ K(t)B i (t)R _1 Bj (t)K(t)-Q (t) 
K(t f ) = Di. 



Performing the matrix multiplication to form BJK of 
equation (4.72) indicates that 
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f 



B|(t)K(t) - 



^ (b'0'O'...O'J ^ 



-11 


-12 • ' 


• £ 


-21 


-22 ' ' 


. K 



K 



A 



-r+l,r+l 



\ -r+1,1 

={ E 'Sll B'K 12 . . . B'K 1>r+1 ] . 

Using (4.74) in (4.72) yields the form of the control 



J 

(4.74) 



law 



u*(t) = -R 1 B'[K 11 x + i | 1 K 1?r+1 s i ] . (4.75) 



Note that in this formulation the matrix in equation 
(4.73) is not a function of K(t). 

As in the Cassidy and. Lee formulation ^ If the condi— 
tions mentioned at the end of section A are met, then as 
t^-*°°, K(t)+K (a constant matrix). Then again K = 0, and 
equation (^.73) reduced to [(r+l)n] 2 nonlinear algebraic 
equations. However, because K is symmetric only 
[(r+l)n + l][(r+l)n]/2 of the equations need to be solved. 

The structure of the low sensitivity control system 
resulting from Kahne ' s approach is illustrated in Figure 7» 
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Figure 7* Block Diagram of Kahne's Low Sensitivity 
Linear Regulator. 



7 ^ 





V. APPLICATIONS OF SENSITIVITY DESIGN TECHNIQUES TO A 
FLEXIBLE SATURN BOOSTER PROBLEM 



A . THE PROBLEM 

In order to investigate some of the proposed low- 
sensitivity design strategies, a realistic problem was 
studied. The problem was to find a feedback control sys- 
tem for a large flexible booster and to apply several 
techniques in desensitizing its performance to parameter 
variations. The equations of motion and control theory 
applicable to the stability and response analysis for a 
large flexible launch vehicle were presented in detail by 
Garner [35] and modelled by Rillings (Saturn V-Apollo con- 
figuration) [36]. The dynamics of the Saturn V-Apollo 
launch vehicle was formulated and several constant-gain 
feedback controllers were obtained and evaluated. 

It is well known that a long slender rod, unconstrained 
at its ends, when excited by a radial force pulse will vi- 
brate in bending modes and at frequencies determined by its 
structural characteristics. The Saturn V-Apollo configura- 
tion of a launch vehicle can be characterized as a long 
slender rod having a length to diameter ratio of about 10:1. 
The flexible character of this booster system must be taken 
into account when designing the control system. 

The large size of the Saturn V-Apollo configuration, 
shown in Figure 8, makes determination of the parameters 
describing its bending modes and frequencies extremely dif- 
ficult. The parameters are generally determined by dynamic 
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testing, and the resulting inaccuracies must be considered. 
Therefore, the control system must not be sensitive to these 
uncertain parameters. 

The problem is to design a constant-gain feedback con- 
troller that gives adequate control when the uncertain pa- 
rameters differ from the nominal values by as much as 20$. 



105 — 



0 J — 

(meters ) 




gimballed engines 



Figure 8. Vehicle Configuration. 

Assuming exact knowledge of all of the states, a con- 
trol that consists of gimballing the engines producing the 
thrust for the booster, and two frames of reference, 
Rillings [36] developed the following linear differential 
equations that describe the motion of the vehicle 
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<fi = - 



R'l 1 

eg 



a = - 
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(T-D 



(N'l 



3 - 






mv 



4 > + — 



fi\r_ 

mv v 



n = - 



R'Y(x ) 

2£cori - to 2 n + — - — 3 



m 



<t> d = <t> + Y' (x d )n 



4> r = 4> + Y’(x r )n 



a 


(5.D 


• \ /_ . \ 

v R 1 0 

a - $ 

v mv 

/ \ J 


(5.2) 




(5-3) 




(5.4) 




(5-5) 



where the variables are defined in Table 1. The state vari- 
ables are defined as follows 

x ^ <j) A 

x 2 



< > \ t 

' x 3 ( = |a 

x 4 

v x v 



n 

^ J 



(5-6) 



By substituting (5*4) and (5*5) into (5*1) and (5.2) 
the following state equations are obtained. 



<!>d = <f> r + [ Y '^ x d^ " Y '( x r )]h 



N'l 



<$> = 
r r 



£2- a-Y' (x )w 2 n-2ccoY' (x )n 



(5-7) 
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(5.8) 
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— Y ’ ( x )ri - — 3 
r mv 



n = n 

R'Y(x ft ) 

n = - W 2 n - 2cwri + - ---- 3 



(5-9) 

( 5 - 10 ) 

(5.H) 



Making the notation compatible with that of chapter 
IV, the control angle is defined by 

M = 3 (5.12) 

The uncertain parameters to which the system is gener- 
ally very sensitive are to and Y'(x ). In the following 
development only the single parameter, to, will be considered 
in order to limit the size of the problem. 

By defining the coefficients of the matrix A and the 
matrix B as 



N'l 



a l = Y ' (x d ) 



a 2 = Y'(x r ) 



a 3 



~cp 



a Zj = 2? 



R'l 



b l = 



'eg 



' a 2 b 3 
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5 mv v 



h = RV_ 
2 mv 



N 1 



v 



= — — + — 
6 mv v 



R'Y(Xp) 



m 



equations (5. 7) - (5-H) can be written in state variable 
form as 

x = Ax + by (5.13) 

(5-14) 
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TABLE I 
Nomenclature 



<f> 

a 

n 

T 

D 

m 

I 



1 



eg 



1 



cp 



V 



R' 



N' 

Y(x b ) 

c 



CO 

Y' (x d )n 



Y' (x r )n 



*d 

y r 

3 



pitch angle 

angle of attack 

bending mode deflection 

thrust 

drag 

mass 

moment of inertia about C.G. (center of 
gravity 

distance from gimbal to C.G. 

distance from C.G. to C.P. (center of 
pressure 

vehicle velocity 

thrust of gimballed engine 

normal aerodynamic force coefficient 

deflection mode shape at the gimbal 

bending mode damping 

bending mode frequency 

displacement at the pitch angle gyro due 
to the bending mode 

angular rate at the pitch angle rate gyro 
due to the bending mode 

pitch angle gyro output 
pitch angle rate gyro output 
gimball engine angular deflection 
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B. OPTIMAL SOLUTION 



All of the parameters in A and b vary considerably 
during the launch phase as functions of time. However, in 
order to simplify the example a frozen-time-point model of 
the vehicle was used. The control system for the time- 
invariant system should be designed for the most critical 
time of the launch phase. For this problem the time t = 80 
seconds was chosen. At this time the vehicle is subjected 
to extreme aerodynamic forces and wind disturbances. Zero 
problem time in subsequent solutions corresponds to flight 
time, t = 80 seconds. At t = 80 seconds the coefficients 
a^ have the numerical values [36]’. 

a 1 = 1.5X10 -2 a 2 = 7.0X10 -3 a 3 = -2.03X10 -1 

a^ = 2.00X10" 2 a 5 = 1.37X10 -2 a g = 4.07X10 -2 

b 1 =-6 . 15X10 -1 b 2 = 3-34X10" 2 b 3 = 2.55X10 2 . 



The A matrix of equation (5-13) becomes 



f 0 


l. 


0 


0 


8.0X10 -3 N 
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2. 03X10“ 1 


-3. 13Xio -1 


-9.36X10"^ 


-1.37X10" 2 


1. 


-4 .07X10 -2 


2.05X10 -11 


-7.0X10 -3 > 
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V 0 
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-H . 47X10 1 


-1.34X10 -1 , 



where to 

o 
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b = 



The b vector becomes 



6.15X10 
/ -3- 34X10 
0 

2.55X10 



\ 



- 2 



( 5 . 16 ) 



The pair [A,b] above are completely controllable; 
therefore, the optimal control 

y*(t) = - 'Kx(t) (5-17) 

or 

y*(t) = f'x(t) ( 5 . 18 ) 

that minimizes the performance measure 



J = 1 



l 



[x'Qx + py 2 ]dt 



(5.19) 



has a constant gain vector f ' . 

The optimal control for this system was obtained by 
integrating the Riccati equation 



K=-A'K-KA+KB^B'K-Q 



( 5 - 20 ) 



backwards in time until a steady state solution was ob- 
tained using a 4^^-order Runge-Kutta 1 integration scheme. 
Although K is a 5X5 matrix, only 15 equations were solved 
due to symmetry. The constant -gain vector is given by 



f ' = - - b'K . (5.21) 

p - - 

The matrix Q and weighting factor used in the optimal 
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Subroutine RKLDEQ, NPS Computer Facility. 
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and 



P = 1. (5-23) 

The optimal control with to = to 0 was found to be 

(5.24) 

f' = {1.23 1.98 .976 -.0229 -.0153}. 

The optimal trajectories, with to = to 0 3 for xi, x 2 , 

x 3 j and xi, versus time are shown in Figure 9- These curves 
were obtained using an initial condition pitch angle rate 

of 5°/sec. to simulate a severe wind gust. The pitch angle, 

xi is seen to damp out quite rapidly, however there is con- 
siderable oscillation at the natural bending mode frequency. 
The bending mode deflection, X 4 , measured at the gimbal 
station, is large but damps out quite rapidly. The angle 

of attack stays small and returns close to zero in about 
three seconds. The angle of attack then remains at a small 
acceptable negative value for quite a long time. 

In order to observe the effects of parameter varia- 
tions on the system, the normalized trajectory error was 
defined as follows. Let x^ be the trajectory determined 
using the perturbed parameter, to, and let x^ q be the tra- 
jectory determined using the nominal parameter, to 0 3 then 
the normalized error, e^ , is defined by 



e . = 
1 



x . - x . 

1 10 



to - Wo 

In determining sensitivity in this way, there is no ques- 
tion about sensitivity model approximations, or concern 
about excluded terms. 



(5-25) 
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Figure 9 



x^ - Pitch angle (deg) 




x 2 - Pitch angle rate (deg/sec) 





- Angle of attack (deg) 



-4 



( sec) 



- Bending mode deflection (m) 




\J 





(sec) 



t 



Optimal Control; u> = w ; Y = Y . 

5 o’ o 
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and bending 



Error trajectories for pitch angle, e^, 
mode deflections, e^, along with the control, y, are shown 
in Figure 10. These curves were generated by using an ini- 
tial condition of 5°/sec. for pitch rate. The perturbed 
parameter was w = 0.8 aj Q . The pitch angle error trajectory 
e^, is oscillatory at the frequency, to. It reaches a peak 
value of about 1.2 and decays slowly to about 0.4 after 6 
seconds. The bending mode deflection error trajectory, e^, 
was observed to have about the same general characteristics. 
The control history had a large initial value of about 10° 
which decayed rapidly to a small value. The coupling of 
the bending mode frequency onto the control was small but 
noticable . 

These normalized error results \tfere difficult to 
analyze meaningfully. They indicated that if parameter 
variations were increased, that the error would be in- 
creased also, but this was already known from (5.25). 

In order to establish a measure for the sensitivity 
of a system which provided a meaningful basis for compari- 
son, the following integral squared errors were defined. 



and 



J 



x 



J 

s 




x ' xdt 



s 1 sdt 



J 

y 




py 2 dt . 



( 5 . 26 ) 



(5-27) 



( 5 - 28 ) 
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- Normalized pitch error (sec) 






Figure 10. Optimal Control: Aw=w o - 0.8 Y = Y q . 
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The vector, s, in (5-27) was the same as that defined by 
equation (3*83). For the optimal controller, and nominal 
plant, with t^, = 20 seconds, the values were 

J x - 

J s - 1,550 

and 

J y = .0393. 

In order to obtain more information about the sensi- 
tivity of the system to variations in co, the response of 
the optimal system was obtained for go = 0.8go o . The re- 
sulting trajectories for xi, x 2 , x 3 , and x 4 versus time 
are shown in Figure 11. Additionally, J x , J g , and 
were computed for this case. The result with t . = 20 
seconds was 

J =66.1 
x 

J = 11)6.4 
s 

J = 0.0392. 

y 

The system was excessively sensitive to a 20% variation in 
co. Additionally, the maximum bending mode deflection of 
about 2.0 meters was excessive. 

In order to reduce the sensitivity several proposed 
techniques were utilized. The results are reported in the 
following sections. 
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- Pitch angle (deg) 







Figure 11. Optimal Control: w=0.8w:Y=Y. 
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C . KAHNE ' S METHOD 

By augmenting the system equation (5-13) with the sen- 
sitivity equation 

Sj(t) = 3A 1 (w)x(t) + A(w)s 1 (t) (5-29) 

the augmented system 



z(t) = AjCwJzCt) + b x u(t) (5-30) 

was obtained. The matrix 3A X = 3A/3to, was defined by 






3Ai 



0 0 0 0 
0 0 0 -2a 2 w -d-2 a l\ 



= < 0 0 0 0 0 

0 0 0 0 0 

0 0 0 - 2(0 -a, 



(5.3D 



J 



where the matrix A was defined by (5-1*0. The vector bj 
was defined by 

b 
0 






(5-32) 



The matrix A^ of equation (5-30) was defined by the parti- 
tioned matrix f \ 



*1 = 



A 



3A X 



0 

A 






(5-33) 



The numerical values for A and b were defined by (5-15) and 
(5-16). The numerical values for the matrix 3A^ were the 



following 
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3 ^1 = 



< 
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0 



-9 .36x10 
0 
0 

-1.34x10 



-2 



0 \ 

-4 



+1 



•1.4X10 
0 
0 

■2.0X10“ 2 y 



( 5 . 34 ) 



The pair [A , bj were not completely controllable for 
this case. Under these circumstances, the problem could not 
be cast as an infinite-interval process, hence there was no 
guarantee that a solution with constant-gain feedback existed. 
Following a suggestion by Kirk [2] , the problem was cast as 
a finite time problem of long duration. The problem was de- 
fined to find y(t) = f'(t)z(t) such that the performance 
measure 

r 1 

J + 3 sz , (t f )D 1 z(t f ) + h\ [x'Qx + s'Ws + py 2 ]dt (5-35) 

0 



was minimized. The final time t^ was chosen to be 200 sec- 
onds and the value of the weighting matrix was D 1 = 0. 

The weighting matrix Q and scalar p were defined by 
(5.22) and (5.23) respectively. The matrix W was defined 



by 



W = < 



0 

0 

0 

0 

0 



0 0 
0 0 
0 0 
0 0 
0 0 



0 0 

0 0 

0 0 > 

.01 0 

0 .01 



(5.36) 



The Riccati equations were integrated backwards in time 
and a nearly steady state solution was reached. Since t^ = 
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200 seconds was much longer than the interval of interest, 
the time-varying gains were approximated by 

f « = _ i b 'K(O) . (5-37) 

It should be noted that obtaining the above solution re- 
quired the solution of 55 nonlinear differential equations, 
where the advantage of the symmetry of K(t) was used. 

The numerical values thus obtained for the feedback 
gains were 

f* = {1.25 2.5^ 1.06 -.287 -.0526 

(5-38) 

000 -.494 -. 0636 }. 

The trajectories for pitch angle, x^, pitch angle rate, 

x 2 , angle of attack, x^, and bending mode deflection, x^ , 

for oj = to , are shown on Figure 12. The oscillations which 
o 5 

were present in Figure 9 are gone. The peak value of pitch 
angle has increased to about 3° • The over-shoot of angle of 
attack is also increased. The maximum bending mode deflec- 
tion however has been reduced to about half of the value 
obtained with the optimal controller, and the oscillations 
at the bending mode frequency have almost been eliminated. 

Figure 13 shows the sensitivity functions, s-^ = 3x^/8o), 
s !| = 3 x i|/9 w and the control history, y, for w = co q . These 
sensitivity terms were reduced considerably compared to the 
optimal solution with no sensitivity considerations included. 

The values of J , J , and J , with t„ = 20 sec. and 

x 5 s_ 5 y 5 f 

w = to were 
o 
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Figure 12. Kahne Control: w=w • Y = Y 

o J o' 
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- Pitch angle sensitivity (sec) 



O', 
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s 2 ~ Pitch angle rate sensitivity (— ) 
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Figure 13- Kahne Control: w = w ; Y = Y . 

o o 
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2.64 



J s = ^ 23 

and 

J = .0596. 

y 

Figure 14 shows the trajectories with the parameter, 
to = 0 . 8 w q . The trajectories x^ and x^ changed less than 
10% from nominal at their maximum value, however, x^ in- 
creases by almost 65 % • This was a greater percentage change 
than the approximately 45% change that occurred with the 
same parameter variation for the optimal system. However, 
in this case even with a parameter change of 20%, the maxi- 
mum bending mode deflection was about 1.2 meters which is 
considerably less than the 2 meters for the optimal case. 

The values of J , J , and J , with t„ = 20 sec. and 

x s y f 

= 0.8w were 
o 

J = 3-82 
x J 

J = .538 

s 

and 

= .0591 

Figure 15 shows the sensitivity functions, s^ = 3x^/3u>, 

s i| = 3 x^/3w, and the control history, y, for w = 0.8w o . 

The system with Kahne's controller was considerably 
less sensitive than the optimal system. In order to improve 
the sensitivity a trade-off between the variations of x^, x 
and x^ and the variations of x^ and x^ and the sensitivity 
trajectories occurred. There was large variation in the control 
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Figure 14. Kahne Control: to=0.8w ; Y = Y . 

° o 5 o 
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s 2 ~ Pitch angle sensitivity (sec) 




s 2 - Pitch angle rate sensitivity (-) 




S H ~ Pending mode deflection sensitivity 

IIlQ-.5e.c) ./dagj t 

8 (sec) 





Figure 15- Kahne Control: a> = 0 . 8co : Y = Y . 

o J o 
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magnitudes. Kahne's controller also resulted in a con- 
siderable change in the oscillation frequency and magnitude 
of the bending mode deflection which was a desired result. 



D. CASSIDY AND LEE'S METHOD 

In this case the system equation (5*13) was augmented 
with the sensitivity equation 



s j (t) = 3Ai( w )x(t) + A(w)si(t) + 3Bi(w)u(t) (5-39) 

SjCO) = o. 



The augmented system equation was 

z(t) = A 1 (w)z(t) + bjn(t). (5-40) 



The matrix AjCco) was defined by the partitioned matrix 



A 

- 1 



Q 





(5.41) 



v y 

where A and 3Aj were defined by (5-14) and (5-31) 3 respec- 
tively. In this case the vector b was not a function of 
to, therefore 3B 2 = 0 and 



(5-42) 



The. matrix A from equation (4 .61) was A = A + bf'. Ex- 

A /\ 

pressing A in terms of elements of K instead of f , A = 

A - 1/p bb'K^ which is the applicable expression obtained 
from (4.65). The nXn matrix was defined by the parti- 
tioned matrix 
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The numerical values for A, 3A x , and b were defined by 
(5*15)j (5*16), and (5-3^) respectively. The numerical 

A 

values for A remain to be determined. 

The problem was to find the y* = f'z that minimized the 
performance measure (5*35) with weighting matrices Q and W 
and the weighting scalar p defined by ( 5 - 22 ), ( 5 * 36 ), and 
(5-23) . 



The modified 2nX2n matrix Riccati equation 




K(t f ) = 0 

was integrated backward in time until a steady-state solu- 
tion was obtained. 

The numerical values obtained from f' = - 7 - b*K in were 

P - -11 



f 1 = { 1.23 2.28 1.03 -.1211 -.0352 

1.33 2.28 1.07 -.272 -. 0092 } . 



(5.-45) 



In this case with the numerical values of A determined, 
the pair [A, b] were completely controllable, therefore the 
conditions for the infinite-interval regulator problem to 
have a steady state solution were satisfied. 
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Figures 16 and 17 show the Cassidy and Lee control sys- 
tem trajectories x^, x 2 > x^, x^, s^, s 2 , s^, and y versus 
time for w = to . Comparing them to Figures 12 and 13 
(Kahne control system) showed small differences. Figures 
18 and 19 for the Cassidy and Lee control system, with 
co = 0 . 8co , when compared with Figures 14 and 15, the com- 
parable trajectories for the Kahne control system, also 
showed small differences. One concludes that the two 
methods were approximately equivalent in sensitivity reduc- 
tion and control. Comparing J x , J g , and between the two 
systems indicated that the Cassidy and Lee controller led 
to a less sensitive system but at a greater cost in J . 

Jx. 

The values J , J , and J , with t~ = 20 sec. and to =co 
x J - s * y f o 

v j e r 0 

j x = 3.780 
j s = .2909 

and 

J = .0^91. 

V 

For co = 0 . 8co the values were 
o 

J x = 5.727 
J = .4758 

and 

J = .0^88. 

y 

Of course, all of the results obtained above were di- 
rectly related to the weighting matrices Q and W used in the 
problem solutions. Both of these matrices were obtained by 



trial-and- -error techniques. 
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Figure 16. Cassidy and Lee Control: w=w : Y = Y . 

o 3 o 
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- Bending mode deflection sensitivity 

[(m-sec)/deg] 
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Figure 17 . Cassidy and Lee Control: w = w ; Y = Y . 

o 5 o 
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Figure 18. Cassidy and Lee Control: co=0.8u • Y = Y 

/ o o * 
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Figure 19 . Cassidy and Lee Control: a> = a> ; Y = Y . 

o o 
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The weighting matrix, Q, was obtained by guessing a 
suitable form, solving the Riccati equation, and obtaining 
the resulting system trajectories. The values in Q were 
perturbed until a system that was sensitive to variations 
in to was obtained. In addition to the sensitivity re- 
quirement, the maximum control magnitude was to be less 
than 10° and pitch angle, angle of attack and the maximum 
magnitude of bending mode deflection were to be small. 

These criteria were partially achieved. 

The weighting matrix, W, was selected from considera- 
tions of control, trajectory and sensitivity dispersions as 

indicated by the integral measures J , J , and J . A para- 

p x s 

meter, X, was defined such that 

W = X l 

i, 

The Kahne solution was obtained for various values of X. 

The values of J , J , and J were obtained, for each system 
determined by the values of X, by integrating (5-26), (5-27)> 
and (5.28) with to = (o q and t f = 20 sec. The integrations 
were repeated for to = 0 . 8to Q . Two additional integral mea- 
sures J„ and J lr were defined by 



0 0 
0 

0 1 



(5.*»6) 



J 



Qx 




f 

x ' Qxdt 



0 



(5-47) 
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and 



J„ 

Ws 




s’Wsat . 



(5.^8) 



The values of these Integrals for o ) = w and u> = 0 . 8w 

o o 

with t^ = 20 seconds were determined. Table II contains 
the values of J , J n . J , J, r , and J,. determined for the 

X y X S WS M 

Kahne control system with w = w . Values were determined 

o 

corresponding to a range of values for X from X = 0 (the 

optimal control) to X = 1. The Cassidy and Lee solution 

for X=.01 is also included. Table III contains the same 

information for u> = 0 . 8 to . 

o 

Prom the data in Tables II and III the trade-off 

curves of Figures 20 - 23 were obtained. Figure 20 shows 

the dispersion of J versus the dispersion of J ; this 

X s 

result is contrary to that obtained by Cassidy and Lee as 
shown in Figure 10 of [22]. The results indicated by Fig- 
ure 20 were as expected for this problem, however, since 
the weighting matrix Q used in the performance measure in- 
dicated a lack of concern about states x^ and x,_. It was 
expected that they would contribute heavily to J as they 

X 

did for the optimal case. The weighting matrix W on the 
other hand was such that emphasis was placed on states x^ 
and x c . 

D 

Figures 21 and 22 indicate the cost in terms of control 
required to obtain a measured value of state and sensitivity 
trajectory dispersion respectively. Figure 23 indicates the 
optimal cost J* = Jq x + J , as a function of sensitivity tra- 
jectory dispersion. 



TABLE II 



INTEGRAL MEASURE VALUES 



to = to 

o 



X 


J 

X 


J Qx 


J 

s 


J Ws 


J 

y 


1 

0 


41.0 


3. 4X10 -3 


1 j 550 


0.0 


.0393 


10- 6 


20.1 


3 . 4X10 -3 


153 


1. 53X10 -4 


.0401 


10 -5 


12.4 


3.6X10 -3 


32 


3.16X10 -4 


. 04l4 


H 

O 

1 

-Cr 


7.4 


4.1X10 -3 


6.5 


6.5X10 -4 


.0438 


10 3 


4.4 


5. 3X10 -3 


1.5 


1. 5X10 -3 


.0487 


C\J 

1 

o 
1 — 1 


2.6 


8.1X10" 3 


. 42 


4.2X10 -3 


.0596 


10 1 


1.5 


1. 7X10" 2 


.15 


1.5X10 -2 


.0881 


io-° 


• 99 


4 . 3X10 -2 


.063 


6.3X10 -2 


.1176 


C&L 2 


' 3-8 


5. 4X10 -3 


.29 


2.9X10 -3 


.0491 



1 Optimal Solution 

2 Cassidy and Lee Solution with X = .01. 

TABLE III 

INTEGRAL MEASURE VALUES 
a) = 0 . 8w 



X 


j 

x_ 


J Qx 


J 

s 


J,, 

Ws 


J 

u 


0 


66.0 


3.9X10 -3 


146 


0 


.0392 


10- 6 


33-5 


4 . 0X10 -3 


80 


8.0X10 -5 


.040 


10 -5 


19.7 


4. 4X10 -3 


30 


-4 

2.9X10 


.0412 


10 -4 


11.5 


5 . 4X10 -3 


7-2 


-4 

7.2X10 


.0436 


io“ 3 


6.7 


7 . 7X10 -3 


1.8 


1.8X10 -3 


.0484 


10 -2 


3-8 


1.4X10 -2 


• 54 


5 . 4X10 -3 


.0591 


^ — 1 

1 

0 

H 


2.1 


3 . 4X10 -2 


.20 


2.0X10 -2 


.0875 
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TABLE III (continued) 



o 
o 
1 — 1 


1.4 


1.1X10 1 


.0.94 


9 . 4X10~ 2 


.1774 


C&L 


5.7 


8.0X10 -3 


. 476 


4.8X10 -3 


.0488 



By studying the trade-offs indicated by Figures 21, 22, 

-2 -2 

and 23> a choice of X = 10 or 10 J becomes obvious. A 

_ 2 

value for A = 10 was chosen. Figure 20 was checked with 
this value and the choice was further confirmed. 

This was the method used for choosing the weighting 
matrix W; a trial-and-error method with added performance 
curves to aid in the design. 

The Kahne solution for A = .01 was chosen to be compared 
with the Cassidy and Lee solution for the same value of A. 
This was done and the results indicated previously further 
confirmed the choice of A. 

E. USE OF Q MATRIX FOR REDUCED SENSITIVITY 

Kalman [16] proved that the optimal feedback control 
law y* that minimizes the performance 

f tf 

J = k I [yx'Qx + y 2 ]dt (5-^9) 

0 

and satisfies the constraints of a completely controllable 
linear single-input plant can be desensitized by the ap- 
propriate choice of y. The assertion is that as y increases 
the return difference increases and sensitivity to plant 
parameter decreases. The example of this chapter was solved 
for y = 2.0 and for y = 10.0. 
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Figure 20. J vs . J , trade-off data. 
X s 




Figure 21. J vs . J , trade-off data. 
° y x ’ 

10 7 




Figure 22. J vs. trade-off data. 
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The solutions were obtained in exactly the same way 
that the optimal solution was obtained except that the 
weighting matrix Q was multiplied by y. 

The gains obtained for y = 2.0 were 

(5-50) 

f' = { 1.77 2.36 1.29 -.0346 -.0186}. 

Figure 24 shows the trajectories x^, x^, x^, and x^ 

versus time for w = w . The trajectories were almost 

o 

identical with those of Figure 9, the optimal case, y = 1.0; 
the maximum value of x^ was larger, 1.55 compared to 1.4. 
The trajectories of Figure 24 were slightly more damped 
than those of Figure 9 • 

Figure 25 shows trajectories x^, x^, x^, and x^ versus 
time for w = 0 . 8w o . These trajectories were substantially 
the same as the comparable optimal trajectories of Figure 

11 . 

Although the maximum control amplitude increased by 
about 1.2°, there was not a significant improvement in the 
sensitivity of the system, as indicated by Figure 26. 

The gains for y = 10.0 were 

(5-51) 

f’ = (3.97 3.74 2.69 -.0886 -.0303). 

With a maximum control value of 19° , twice that for the 
optimal solution, a system with considerably more damping 
was obtained. However, the maximum bending mode deflection 
was also increased. The results are shown in Figures 27, 

28, and 29. As predicted by Kalman, the resulting system 
was less sensitive with y = 10.0 than for y = 2.0 or 
y = 1.0 
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Figure 24. Optimal Control (y=2) : oo=w : Y=Y 
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Figure 25- Optimal Control (y=2) : u)=0 . 8w : Y=Y . 

o J o 
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Figure 26. Optimal Control (y = 2) : Au)=to-0 . 8w ; Y=Y . 
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Figure 27. Optimal Control (y=10): m=aj : Y=Y . 
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Figure 28. Optimal Control (y=10): w=0 . 8w ; Y=Y . 
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Figure 29. Optimal Control (y = 10) : Aw=oj -.08w : Y=Y 
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p. 



DISCUSSION OF RESULTS 



All of the methods used resulted in a system with re- 
duced sensitivity compared to the optimal solution. The 
Kahne and Cassidy and Lee solutions were obtained by con- 
siderably increasing the size of the problem (55 Riccati 
equations versus 15 for the optimal solution) . The com- 
plexity of the problem increases enormously as additional 
parameters are considered. For example, if the parameters 
q = (a) Y'(x )}' in the example had been used then 120 
Riccati equations would have been integrated to obtain the 
solution. Application of these methods to a system in 
which the product n(r+l)>10 results in almost prohibitive 
computational difficulties. Integration of the 55 Riccati 
equations for the example with t^ = 100 sec. and using the 
largest possible time step that gave a stable solution, re- 
quired 19 minutes of computer 2 time. This amount of com- 
puter time is quite large when compared with the two minutes 
required for the solution of the optimal control. 

One of the advantages cited for using a technique that 
includes sensitivity in the performance measure is that it 
provides analytical control over the degree of insensitivity 
obtained. Figure 20 and Figure 21 show that this is true; 
however, one must add that obtaining the weighting matrix 
W that provides the degree of sensitivity required is a 
trial-and-error procedure. The data in Tables II and III 



2 

IBM - 360/67- 
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were obtained by solving the Kahne problem seven times and 
the Cassidy and Lee problem and the optimal problem each 
once. This required over 160 minutes of computer time, a 
very great cost for most designs. The point is that these 
techniques were trial-and-error techniques as was finding 
the optimal solution, because no method of determining the 
weighting matrices Q and W was available. 

As stated earlier, there were two parameters to which 
the system was sensitive. The parameter q = to was chosen 
for the example because it did not appear in the b matrix 
and therefore Kahne 's technique was applicable. Desensi- 
tization of the system was achieved with respect to the 
parameter, to, but what of the parameter, Y'(x )? There was 
nothing in the analysis technique that indicated how the "de- 
sensitized" system would respond to variations of a para- 
meter not explicitly included in the performance measure. 

In fact it could very well happen that desensitizing with 
respect to one parameter might increase the sensitivity 
with respect to another. A designer having obtained a 
tentative solution to his control problem must check the 
sensitivity of the system to variations of the other plant 
parameters. In this example a check on sensitivity to 
Y'(x r ) only was made. 

The optimal control, the Kahne control, and the Cassidy 
and Lee control were each applied to the plant model with 
the parameters Y'Cx^) = 1.2Y^(x ) (increasing Y'(x^) pro- 
duced the greatest sensitivity) . The optimal system was 
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unstable in this case as indicated by trajectories x^, x^ 3 

x^, and x^ shown in Figure 30. The values of the integral 

measures for Y = 1.2Y were 

o 

J x = 1794 
J s = 52,350 

and 

J = .0429. 

V 

The Kahne system response with Y = 1.2 Y q was very 
nearly identical to the nominal system as shown in Fig- 
ure 31 and Figure 32. The values for the integral measures 
for Y = 1.2 Y q were 

J =2.79 

x 

J =0.443 
s 

and 

J = 0.0596 . 

V 

These values were very little different from those 

obtained for to = to and Y = Y shown in Table II. In fact 

o o 

the system was less sensitive to variations in Y than it 
was for variations in to . 

The Cassidy and Lee system response with Y = 1.2Y 
was also close to the nominal system as shown in Figure 33 
and Figure 34. The variation was only a little larger than 
that noted for the Kahne controller. The values for the 
integral measures for Y = 1.2Y were 
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Figure 30. Optimal Control: to = to ; Y = 1.2Y q . 
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x^ - Pitch angle (deg) 






Figure 31* Kahne Control: to = to : Y = 1.2Y . 

o o 
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s 1 - Pitch angle sensitivity (deg-m) 
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s 2 - Pitch angle rate sensitivity [ (deg-m) /sec] 
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Figure 32. Kahne Control: w=w ; Y = 1.2Y 
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Figure 33- Cassidy and Lee Control: to =to ; Y=1.2Y . 

o o 
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s^ - Pitch angle sensitivity (deg-m) 
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Figure 3^- Cassidy and Lee Control u)=w o ; Y = 1.2Y q . 



123 



4.16 



J =0.28 
s 

and 

J y = 0.049. 

It is interesting to note that the system sensitivity with 

respect to w for Y = 1.2 Y q was slightly less than for 

the nominal case, J =0.28 compared to J =0.29. As 

s s 

was true for the Kahne controller, the Cassidy and Lee 
controller was less sensitive to variations in Y'(x r ) than it 
was to variations in w. 

For this problem, the Kahne control system and the 
Cassidy and Lee control system provided very similar results 
in terms of sensitivity reduction as measured by the inte- 
gral measure J . The Kahne controller provided this result 
with a less complex controller and with less computational 
difficulty (A was not a function of elements of K for the 
Kahne solution) . 

Since the methods discussed were all essentially trial- 
and-error methods, perhaps more effort should have been put 
into finding a weighting matrix, Q, for the optimal case 
that gave results similar to those of Cassidy and Lee and 
Kahne. It is not at all clear how one obtains weighting 
matrices that provide the desired result. For example, in 
the case of the problem presented in this chapter an at- 
tempt was made to solve the Riccati equation with Q = I. 

A solution could not be obtained because the integration 
quickly became numerically unstable. 
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A second optimal solution with weighting matrix 



9 






.75 

.01 0 



< 3.5 



\ 

> 






0 



.01 



.01 



J 



was obtained. The feedback gains were 



(5-52) 



f' = {1.25 2.98 1.16 -.246 -. 116 } (5-53) 



This control law resulted in a system with 
sensitivity and performance, compared with 
timal solution, as indicated in Figures 35 



greatly improved 
the previous op- 

- 38. 



125 






2 4 



- Bending mode deflection (m) 




t 

(sec) 



Figure 35. Optimal Control II: a 3 =co • Y=Y . 
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Figure 36 . Optimal Control II: a)=0.8co : Y=Y 

o 5 o' 
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Figure 37. Optimal Control II: 



w=io • Y=1 . 2Y 
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Figure 38. Optimal Control II: Aa>=w-0 . 8w : Y=Y 
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VI. CONCLUSIONS 



A . SUMMARY 

In this thesis several sensitivity analysis and design 
techniques as applied to optimal control systems have been 
evaluated. Of the methods of sensitivity analysis examined 
none provided a clear direction for extension to design 
techniques . 

The basic results of Kalman , Perkins and Cruz, and 
Kreindler, applicable to linear regulator systems, provided 
an important bridge between optimal control theory in the 
time domain to classical control theory in the frequency 
domain. The direct relationship between stability and in- 
sensitivity demonstrated in the discussion of Kalman's work 
may contain a key to methods for applying some of the clas- 
sical design techniques to the solution of desensitized 
linear regulators. This possibility will be discussed in 
the next section. 

A sensitivity analysis model for optimal feedback sys- 
tems was developed following well known methods. The re- 
sulting sensitivity equation was specialized to the linear 
regulator problem. The main disadvantage of this approach 
is that an independent analysis is required for each para- 
meter considered. The Perkins and Wilkie analysis method 
eliminates this disadvantage for completely controllable 
linear regulators by solving for trajectory sensitivity to 
all parameters simultaneously. This is accomplished by 
transform: ng the state equations to the companion canonic 
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form, in which all of the parameters of the original system 
combine to form the coefficients of the open-loop character- 
istic equation. 

Utilizing the sensitivity equation 

3u 

s. = 3A.x + 3B.u + As. + B -r (3-84) 

-l -l- -l- — l - 3q^ 

an optimization problem with sensitivity constraints was 
formulated and solved for the linear case. The resulting 
control law, due to Higginbotham, proved to be very diffi- 
cult if not impossible to implement. Two simplified tech- 
niques, resulting from simplifying assumptions and neglected 
terms in the sensitivity equation, as proposed by Cassidy 
and Lee, and Kahne were introduced. These schemes required 
augmenting the n th -order system equation with r n th -order 
sensitivity equations, and including a quadratic sensitivity 
term in the performance measure. The increase in size and 
computational difficulty of the resulting optimization prob- 
lem severely limits the utility of these techniques. 

In order to apply some of the techniques discussed, a 
5^-order linearized model of a flexible Saturn V-Apollo 
launch vehicle during booster powered flight was presented. 
An optimal (intentionally sensitive) solution to the re- 
sulting linear regulator problem was generated. The state 
equations were then augmented with the Kahne sensitivity 
equations and the resulting lO^h-order optimization problem 
was solved. The Cassidy and Lee solution was also obtained. 
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Both of these methods yield control laws that provide con- 
siderably reduced sensitivity compared to the optimal sys- 
tem . 

Kalman suggested that sensitivity could be decreased 
by solving the modified optimization problem obtained by 
multiplying the trajectory weighting matrix, Q, by a scalar 
y. Solutions to the resulting problem with y = 2 and 
y = 10 were obtained. The resulting systems were indeed 
less sensitive than the optimal with y = 1, but at a cost 
of considerably more control effort. 

The problem was also solved as an unconstrained optimal 
control problem with a different trajectory weighting ma- 
trix, Q. The resulting system had sensitivity characteristics 
similar to those obtained by the Cassidy and Lee, and Kahns 
methods . 

With these results one is forced to ask "why bother with 
these extremely complex techniques, if the same result can 
be obtained by solving the much simpler unconstrained optimal 
control problem"? The answer is not at all clear since both 
approaches are trial-and-error with respect to determining 
weighting matrices. It was clear, however, that a better 
unconstrained design would be obtained if sensitivity were 
considered at each iterative step in the design process. 
Generating the data for the design curves of Figures 20-23* 
once the feedback gains were obtained, required much less 
computational effort than solving the Riccati equation. 

Similar design aids could be generated and used in obtaining 
the "best" unconstrained optimal solution. 
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B. RECOMMENDATIONS 



A design technique for reduced sensitivity optimal 
controls which does not require augmenting the state equa- 
tions or adding a term to the performance measure would be 
a highly desirable result. An area for further work with 
this in mind was found in Kalman's result for the inverse 
problem [16] . 

The basis for the design algorithm to be outlined is 
contained in the following ideas : 

1) A completely controllable linear single-input sys- 
tem can be transformed into the companion canonic form. 

2) The system characteristic equation is invariant 
under such a linear transformation. 

3) A s t ab 1 e control law f for a completely control- 
lable linear single-input system is an optimal control law 
if and only if 



| 1 - f ' $( s )d | 2 = | T k (s)/'T(s) | 2 >1 (3-25) 

or 

|^ k (jw)| 2 - |^(jw) | 2 >0. (6.1) 

*1) The polynomials ip^ and ip are the closed-loop and 
open-loop system characteristic polynomials. 

5) For a system in companion canonic form, if the 
open-loop characteristic polynomial is 

'i'(s) = s n + a n sn ^ + ••• + a i (6.2) 

then the closed loop characteristic polynomial can be written 
as 
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+ • • • (a i - Yl ) (6.3) 



u/ / \ . / \ n— 1 

V. ( s ) = s +(a — v ) s 

k n 'n 

where the y^ are the elements of the feedback gain vector 

£ ' = {y i Y 2 ... Y n > • (6.4) 

6) The control law in the companion canonic form is 
given by 

b = f'z (6.5) 

where z is the phase-variable state vector. Since 

z = Tx , (6.6) 

because of the linear transformation to companion canonic 
form, the feedback gains in the original coordinate system 
are given by 

k ' = f'T (6.7) 

A design procedure that results from consideration of 
the listed ideas is the following: 

1) Transform the completely controllable constant 
single-input system 

x = Ax + by (6.8) 

into the companion canonic form using the Leverrier-Faddeeva 
algorithm [37] • This algorithm yields the characteristic 
polynomial, l'(s) and the linear transformation, T. 

2) Obtain starting values for all y^ in equation (6.4). 

3) Using a search routine, find a set of y^ , i=l,2,...n, 
that make (6.3) Hurwitz. An eigenvalue finding routine and a 
scheme that reduces the real part of the largest eigenvalue 
would work well here. A design constraint on the location of 
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the largest eigenvalue can also be included here. The value 
of (ai - Yi) must be constrained to be greater than ai as 
will be seen. 

4) Having obtained a stable control law, f' = 

{yi y 2 ... Y n ^j test condition (6.1) as follows: 

a) |i 4 k (jw) | 2 = ^ k (co 2 ) 
and similarly 

| 4>( jw) | 2 = ip(co 2 ) . 

Therefore, condition (6.1) is reduced to 

J k (w 2 ) - J(w 2 )> 0. (6.9) 

/V /V. 

b) Since i|> k (oo 2 ) and \p(o) 2 ) are nonnegative for all 
a), and since in step 3 the constraint 

i4 k (0) > ip(0) (6.10) 

was imposed by requiring the condition (aj - Yi ) > ai, then 
condition (6.9) holds for all oo if and only if the equation 

i4 k (w 2 ) - iKw 2 ) = 0 (6.11) 

has no real roots. 

c) The test then is to find the roots of (6.11), 
if none are real, then (6.9) is satisfied and f' is an opti- 
mal control law. If (6.11) has real roots, the process must 
be repeated until a suitable f' is found. 

5) Having found f ' , obtain k' from 

k' = f'T. (6.7) 
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A variation to the procedure which limits the minimum 
value of the return difference is obtained by modifying 
condition ( 6 . 9 ) such that 

rp k (u 2 ) - p 2 ip(cj 2 ) > 0 (6.12) 

where 

p > 1. 

Such a procedure will ensure that the return difference is 
greater than p for all to. That is condition (3*25) be- 
comes 

|1- f ' $(s )b I 2 = | ( s ) /^ ( s ) | 2 > p 2 (6.13) 

There is a connection between the magnitude of p and 
the system sensitivity but it is not clear at this point. 

The choice of p, therefore, remains a problem to be solved. 

This procedure, which could incorporate classical tech- 
niques for determining constraints for the eigenvalues of 
the closed-loop system, provides a simple bridge between 
optimal control systems and classical control systems. If, 
for example, consideration is limited to a range of fre- 
quencies, to < o> 1 , the control resulting would not be optimal 
but would satisfy the closed-loop requirements of a clas- 
sical system. 

It is very likely that this technique can be extended 
to multiple-input completely controllable systems using the 
arguments of Wilkie and Perkins [15] • Since the systems 
are linear, it follows from superposition that 
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X 



(6.14) 



1 , 2 
= x + x + 



+ x 



m 



where x is the response to control Vk , 1 = 1, . . . m. The 
control laws for the decoupled single-input systems could 
be determined and recombined to form an optimal nXm gain 
matrix, F. The nXm matrix F would have the form 



F = { k 



1 -2 



-m } 



(6.15) 



where each k. is determined from 

-l 



k. = f .T. . 
-l -i-i 



( 6 . 16 ) 



The f. of (6.16) are obtained using the above procedure. 



-l 
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